-- Logs begin at Mon 2022-08-29 23:56:05 UTC, end at Tue 2022-08-30 00:53:13 UTC. -- Aug 30 00:22:13.833040 dv-cinder-815712-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 00:22:13.841166 dv-cinder-815712-11-smb devstack@keystone.service[81470]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:22:13 2022] *** Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: nodename: dv-cinder-815712-11-smb Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: machine: x86_64 Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: clock source: unix Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: pcre jit disabled Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: detected number of CPU cores: 4 Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: current working directory: / Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: your processes number limit is 47680 Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: your memory page size is 4096 bytes Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: detected max file descriptor number: 2048 Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: lock engine: pthread robust mutexes Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: thunder lock: enabled Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 00:22:13.847514 dv-cinder-815712-11-smb devstack@keystone.service[81470]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:22:13.885978 dv-cinder-815712-11-smb devstack@keystone.service[81470]: Python main interpreter initialized at 0x5653096e19c0 Aug 30 00:22:13.885978 dv-cinder-815712-11-smb devstack@keystone.service[81470]: python threads support enabled Aug 30 00:22:13.885978 dv-cinder-815712-11-smb devstack@keystone.service[81470]: your server socket listen backlog is limited to 100 connections Aug 30 00:22:13.885978 dv-cinder-815712-11-smb devstack@keystone.service[81470]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:22:13.886351 dv-cinder-815712-11-smb devstack@keystone.service[81470]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:22:13.886422 dv-cinder-815712-11-smb devstack@keystone.service[81470]: *** Operational MODE: preforking *** Aug 30 00:22:13.886679 dv-cinder-815712-11-smb devstack@keystone.service[81470]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:22:13.886679 dv-cinder-815712-11-smb devstack@keystone.service[81470]: spawned uWSGI master process (pid: 81470) Aug 30 00:22:13.886934 dv-cinder-815712-11-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 00:22:13.893567 dv-cinder-815712-11-smb devstack@keystone.service[81470]: spawned uWSGI worker 1 (pid: 81481, cores: 1) Aug 30 00:22:13.893567 dv-cinder-815712-11-smb devstack@keystone.service[81470]: spawned uWSGI worker 2 (pid: 81482, cores: 1) Aug 30 00:22:13.893567 dv-cinder-815712-11-smb devstack@keystone.service[81470]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:22:18.176940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:22:18.176940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Aug 30 00:22:18.177840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:22:18.177840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Aug 30 00:22:18.182988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:22:18.182988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: from cryptography.utils import int_from_bytes Aug 30 00:22:18.183502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:22:18.183502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: from cryptography.utils import int_from_bytes Aug 30 00:22:18.228149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:22:18.228339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:22:18.228525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] command line args: [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:22:18.228798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:22:18.228929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ================================================================================ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:22:18.229206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.229451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_dir = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.229618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.229842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_source = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.229974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] debug = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.230203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.230588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.230757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.231053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.231182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:22:18.231303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.231388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:22:18.231528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.231609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] command line args: [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:22:18.231719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_config_append = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.231800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:22:18.231867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.231926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ================================================================================ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:22:18.232047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_dir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.232172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] admin_token = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.232290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.232408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_dir = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.232539 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.232645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.232774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.232891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_source = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.233013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] debug = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.233132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.233242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.233410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.233534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.234989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_config_append = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_dir = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.235959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.236933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] publish_errors = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.237982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] standard_threads = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_journal = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_json = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_stderr = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] publish_errors = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.238961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_syslog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.239044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.239114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.239184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.239379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.239511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.239593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.239723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.239799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.239875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.240042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] standard_threads = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.240167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.240245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.240331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.240491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.240615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.240692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.240764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.240833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_journal = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.240956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_json = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.241043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.241115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_stderr = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.241220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.241306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_syslog = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.241490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.241676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:22:18.241769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.241851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.241954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242699 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.242986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.243952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.244930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.245844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.246965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.247994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.248166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.248318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.248432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.248545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.248666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.248786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.248899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.249980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250557 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.250986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.251888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.252921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.253908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.254020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.254135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.254233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.254349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.254470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.254584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.255988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.256940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.257924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.258954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.259994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.260912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.261938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.262930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.263931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.264964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.external = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.265932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.password = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.token = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.266884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.external = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.267974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.password = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.token = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.268792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.269979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.270906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.271937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.272990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.273946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.274990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.275921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.276036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.276229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.276345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.276459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.276573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.276686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.276815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.277911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.278949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.279170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.279285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.279493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.279610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.279723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.279837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.279959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.280995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.281813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.282964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.283883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.284922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.285978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.286920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.287944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.288980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.289919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.290944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.291978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.292890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.293817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.294942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.295960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.296967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.297919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.298909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.299965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.300980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.301959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.302878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.303790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.304932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.305982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.306909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.307921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.308955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309068 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.309890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.310922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.311975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.312904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.313946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.314891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.315196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.315313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:22:18.315427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.315427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.315427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.315427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:22:18.315427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:22:18.343601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.343829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.344057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.344173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.344404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.344625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.352504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.353135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.381338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.381610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.381783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.382046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.435329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.435491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.483682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.483934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.484758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.484955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.644892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.645109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.645378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.645582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.645855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.646081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.647221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.647462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.647682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.647895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.648110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.648320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.669409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.669650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.669892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.670933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.671094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.671295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.671480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.681877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.682409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.694835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.695070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.695307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.695453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.695594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.695676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.695798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.695915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.696005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.696082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.696156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.696229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.696470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.696656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:22:18.713374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.713581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:22:18.713979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.714166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:22:18.714292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.714508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.714635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:22:18.714783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.714910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.715034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.715130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:22:18.715261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.715385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.715581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.716150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.716439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.724885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.725172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.725442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.725754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.726381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.726674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.726969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.727271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.732973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.734774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.735911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.736200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.736506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.736816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.737107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.737379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.737702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.737844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.737928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.738143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.738268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.738420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.738590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.738715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.738834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.739035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.739317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.739591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.739864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.740285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.740583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.740860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.761894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.763418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.763683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.765185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.766880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.767098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.768946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.769267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.769585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.771787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.772072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.772351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.776561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.776960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.778788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.779089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.781117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.781434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.781767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.782159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.782440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.783182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.783469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.783730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.784014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.784285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.784544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.784633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.784813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.784896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.785081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.785166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.800830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.801117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.802234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.802507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.805016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.806474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.808353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.808668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.809792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.810084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.813150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.814309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.816447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.817388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.819680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.819982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.820273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.820567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.820690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.820828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.820923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.821141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.821266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.821403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.821732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.822015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.837339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.837625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.837744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.837881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.838031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.838175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.838313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.838555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.844939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.845399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.846656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.846953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.848185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.848465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.848589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.848727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.851169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.851468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.851594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.851723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.851806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.852034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.852157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.852324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.852437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.852680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.864009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.864258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.864385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.864550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.864676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.864803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.864892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.865117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.865248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.865409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.865575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.865660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.865736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.865990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.881356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.881729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.884237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.884751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.887219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.887662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.888666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.889147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.890471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.890708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.890808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.891017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.891201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.891285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.897371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.898019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.898868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.899573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.901935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.902225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.902505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.902629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.902766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.902953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.903276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.903582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.910841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.911146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.911425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.911725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.912021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.912304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.918735 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.919035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.919220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:22:18.919317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.919530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.919656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.919798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.919932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.920118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.920244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.920380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.920459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.920660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.920801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.920950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.921033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.921214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.921340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.921493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.921707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.921793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.921968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.922051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.922124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.922307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.922435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.922555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.922871 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:22:18.957100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653096e19c0 pid: 81481 (default app) Aug 30 00:22:18.957882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653096e19c0 pid: 81482 (default app) Aug 30 00:22:18.960717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188953c-46fc-422b-962a-db4c43214226 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:18.961006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188953c-46fc-422b-962a-db4c43214226 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:18.961279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188953c-46fc-422b-962a-db4c43214226 None None] PATH_INFO: `/v3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:18.965731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Tue Aug 30 00:22:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:25.659582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872e727-7673-4a3b-8a09-a1f472564832 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.660087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872e727-7673-4a3b-8a09-a1f472564832 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.660087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872e727-7673-4a3b-8a09-a1f472564832 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.668209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:25 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:25.677027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.677606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.677606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.748289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: INFO dbcounter [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] Registered counter for database keystone Aug 30 00:22:25.770326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG oslo_db.sqlalchemy.engines [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:22:25.778348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writer thread running {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:22:25.961146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81481) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:22:25.961537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81481) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:22:26.020727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:26.022352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:26.171312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 00:22:26.670563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872e727-7673-4a3b-8a09-a1f472564832 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:26.746450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: INFO dbcounter [None req-1872e727-7673-4a3b-8a09-a1f472564832 None None] Registered counter for database keystone Aug 30 00:22:26.772496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG oslo_db.sqlalchemy.engines [None req-1872e727-7673-4a3b-8a09-a1f472564832 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:22:26.780740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writer thread running {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:22:26.907862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872e727-7673-4a3b-8a09-a1f472564832 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:26.912658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e1d1-4e21-41be-bd9e-c2f8da981e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:26.913303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e1d1-4e21-41be-bd9e-c2f8da981e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:26.913610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e1d1-4e21-41be-bd9e-c2f8da981e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:26.913889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e1d1-4e21-41be-bd9e-c2f8da981e96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:26.923012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e1d1-4e21-41be-bd9e-c2f8da981e96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:26.974569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8f0e1d1-4e21-41be-bd9e-c2f8da981e96 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:22:26.974890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e1d1-4e21-41be-bd9e-c2f8da981e96 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:26.986060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Aug 30 00:22:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:22:26.991987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.007142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0506-44a9-4da9-b821-bf2389e75e57 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.012470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136703e-c1cb-43cd-a7a5-2ff6093056dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.013721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136703e-c1cb-43cd-a7a5-2ff6093056dc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.014008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136703e-c1cb-43cd-a7a5-2ff6093056dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.014280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136703e-c1cb-43cd-a7a5-2ff6093056dc admin admin] PATH_INFO: `/v3/projects/4f231d500254452db95956e5ca509c67` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.015981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136703e-c1cb-43cd-a7a5-2ff6093056dc admin admin] RBAC: Authorizing `identity:get_project(project_id=4f231d500254452db95956e5ca509c67)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.076149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e136703e-c1cb-43cd-a7a5-2ff6093056dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:22:27.076680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136703e-c1cb-43cd-a7a5-2ff6093056dc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.084592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Aug 30 00:22:26 2022] GET /identity/v3/projects/4f231d500254452db95956e5ca509c67 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:28.973259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d427b-056e-4842-81e0-0f049e533d8b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.973868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d427b-056e-4842-81e0-0f049e533d8b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.973868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d427b-056e-4842-81e0-0f049e533d8b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.977995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:28.984938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2845-b7d6-4e7b-84c9-3b3d859064ca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.985353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2845-b7d6-4e7b-84c9-3b3d859064ca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.985535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2845-b7d6-4e7b-84c9-3b3d859064ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:29.018223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d5ae2845-b7d6-4e7b-84c9-3b3d859064ca None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:29.019765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d5ae2845-b7d6-4e7b-84c9-3b3d859064ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:29.029984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 00:22:29.296362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d427b-056e-4842-81e0-0f049e533d8b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:29.311106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d427b-056e-4842-81e0-0f049e533d8b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:29.315910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7b4c1-0040-4c88-8f83-bd2e0dec32b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:29.316509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b4c1-0040-4c88-8f83-bd2e0dec32b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:29.316782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b4c1-0040-4c88-8f83-bd2e0dec32b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:29.317048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7b4c1-0040-4c88-8f83-bd2e0dec32b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:29.324963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b4c1-0040-4c88-8f83-bd2e0dec32b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:29.326808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7b4c1-0040-4c88-8f83-bd2e0dec32b6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:29.335725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Aug 30 00:22:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:22:29.342002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae2845-b7d6-4e7b-84c9-3b3d859064ca None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:29.357299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae2845-b7d6-4e7b-84c9-3b3d859064ca None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:29.366162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2ac0f-7a21-4b1d-a26d-075c6b40c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:29.367083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2ac0f-7a21-4b1d-a26d-075c6b40c193 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:29.367419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2ac0f-7a21-4b1d-a26d-075c6b40c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:29.367763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2ac0f-7a21-4b1d-a26d-075c6b40c193 admin admin] PATH_INFO: `/v3/users/7f29f71fcc134e71ac6d471453d847e2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:29.370033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2ac0f-7a21-4b1d-a26d-075c6b40c193 admin admin] RBAC: Authorizing `identity:get_user(user_id=7f29f71fcc134e71ac6d471453d847e2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:29.372894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2ac0f-7a21-4b1d-a26d-075c6b40c193 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:29.374535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Aug 30 00:22:29 2022] GET /identity/v3/users/7f29f71fcc134e71ac6d471453d847e2 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:31.350270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46724199-6a4f-4e14-8a4d-84c6c152de7f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.350803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46724199-6a4f-4e14-8a4d-84c6c152de7f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.350803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46724199-6a4f-4e14-8a4d-84c6c152de7f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.352138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:31.357414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01003f7-5f30-4c7a-b1bd-0ca40d407188 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.357893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01003f7-5f30-4c7a-b1bd-0ca40d407188 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.357984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01003f7-5f30-4c7a-b1bd-0ca40d407188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.370585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af727a9-8c75-48bf-a358-df63ea8841a6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.370972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af727a9-8c75-48bf-a358-df63ea8841a6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.371246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af727a9-8c75-48bf-a358-df63ea8841a6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.372545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:31.376536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f01003f7-5f30-4c7a-b1bd-0ca40d407188 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:31.377773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f01003f7-5f30-4c7a-b1bd-0ca40d407188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:31.378025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.378332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.378606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.421797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG passlib.handlers.bcrypt [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81482) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:22:31.422161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG passlib.handlers.bcrypt [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81482) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:22:31.461077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:31.470642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:31.472253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:31.581744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:31.727190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01003f7-5f30-4c7a-b1bd-0ca40d407188 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:31.751801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:31.834361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01003f7-5f30-4c7a-b1bd-0ca40d407188 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:31.841402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:31.869136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:31.869911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.870192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.870516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.882651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:31.891562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:31.892463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:31.893348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:22:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:31.898553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:31.947702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4fa24-20c6-4516-9d15-cd4cc14e80ad None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:31.950030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:31.979685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:31.986900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:31.987845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.988128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.988398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.999358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b671148-df8b-4b8b-9c31-6da406c9e664 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.035999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.036643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.036927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.037199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.037909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:32.038218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.039637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.052051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:32.057204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.058044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.059529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.161052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fb594-34db-4741-99b6-f2afc5d8ddec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.164181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:32.170061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.173199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:32.199307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.200110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.200599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.201160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] PATH_INFO: `/v3/users/7f29f71fcc134e71ac6d471453d847e2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.202928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] RBAC: Authorizing `identity:get_user(user_id=7f29f71fcc134e71ac6d471453d847e2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.204842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.206786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:32 2022] GET /identity/v3/users/7f29f71fcc134e71ac6d471453d847e2 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:32.213613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.229122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:32.276966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bca82-191c-4156-9160-30efb7d77da8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.312069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.312933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.313213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.313476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.320800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501299b-6cf7-4903-89cd-4269a46d3d45 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.332186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.333737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:22:32.352676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:32.354034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:22:32.354995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:22:32.354995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:22:32.354995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:32.354995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:22:32.359977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.362230 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.362896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.363172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.363443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.364595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.366111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.367702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:32.373776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.423927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:32.463204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:32.472788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b2946-c304-4ef3-9078-3fb993f20ba1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.483630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399cb9a-8549-4322-b494-a84fc9567685 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.508471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f03c3-efdb-4789-8f63-b1ca9e02ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.509082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f03c3-efdb-4789-8f63-b1ca9e02ac84 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.509383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f03c3-efdb-4789-8f63-b1ca9e02ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.509685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f03c3-efdb-4789-8f63-b1ca9e02ac84 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.510341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f03c3-efdb-4789-8f63-b1ca9e02ac84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:32.510658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f03c3-efdb-4789-8f63-b1ca9e02ac84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.512051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f03c3-efdb-4789-8f63-b1ca9e02ac84 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.518177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f190b1-acaa-44a2-9c5b-46bf10f46478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.518795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f190b1-acaa-44a2-9c5b-46bf10f46478 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.519073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f190b1-acaa-44a2-9c5b-46bf10f46478 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.519338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f190b1-acaa-44a2-9c5b-46bf10f46478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.520438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f190b1-acaa-44a2-9c5b-46bf10f46478 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.domain.id=default, user.id=7f29f71fcc134e71ac6d471453d847e2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:32.520748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f190b1-acaa-44a2-9c5b-46bf10f46478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.522225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f190b1-acaa-44a2-9c5b-46bf10f46478 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.529045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Aug 30 00:22:32 2022] GET /identity/v3/role_assignments?user.id=7f29f71fcc134e71ac6d471453d847e2&scope.domain.id=default&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:32.529825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:34.791593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699eba-b828-4288-9c0d-275c6df8de6b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.792635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699eba-b828-4288-9c0d-275c6df8de6b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.793166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699eba-b828-4288-9c0d-275c6df8de6b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.795110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:34.800368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e9eaa-e284-40f3-9408-72f0c2dc76ae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.801200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e9eaa-e284-40f3-9408-72f0c2dc76ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.801713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e9eaa-e284-40f3-9408-72f0c2dc76ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.830665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a99e9eaa-e284-40f3-9408-72f0c2dc76ae None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:34.831890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a99e9eaa-e284-40f3-9408-72f0c2dc76ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:34.893149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad661d06-0191-47b4-8ed5-e41e614d9444 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.893853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad661d06-0191-47b4-8ed5-e41e614d9444 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.894319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad661d06-0191-47b4-8ed5-e41e614d9444 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.895878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:34.900978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7787082-3d82-4ac4-b734-930ca23989fb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.901700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7787082-3d82-4ac4-b734-930ca23989fb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.902937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7787082-3d82-4ac4-b734-930ca23989fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.920310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:34.935078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b7787082-3d82-4ac4-b734-930ca23989fb None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:34.936635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b7787082-3d82-4ac4-b734-930ca23989fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:35.032809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:22:35.094753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306fef4-e4b4-4a98-947d-0d9e96f9e9ae None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.095059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306fef4-e4b4-4a98-947d-0d9e96f9e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.095227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306fef4-e4b4-4a98-947d-0d9e96f9e9ae None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.096602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 12/26] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:35.103151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeceddc-d35f-4811-b61a-621876438ae3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.103442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeceddc-d35f-4811-b61a-621876438ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.103715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeceddc-d35f-4811-b61a-621876438ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.130794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8eeceddc-d35f-4811-b61a-621876438ae3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:35.131995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8eeceddc-d35f-4811-b61a-621876438ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:35.213606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:35.373918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306fef4-e4b4-4a98-947d-0d9e96f9e9ae None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:35.425614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeceddc-d35f-4811-b61a-621876438ae3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:35.429438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:35.454677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:35.567028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeceddc-d35f-4811-b61a-621876438ae3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:35.603926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f814829-c136-4289-b6e8-96b32ba9c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:35.604870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f814829-c136-4289-b6e8-96b32ba9c3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.605296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f814829-c136-4289-b6e8-96b32ba9c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.605727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f814829-c136-4289-b6e8-96b32ba9c3d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.607156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306fef4-e4b4-4a98-947d-0d9e96f9e9ae None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:35.617621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f814829-c136-4289-b6e8-96b32ba9c3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4f814829-c136-4289-b6e8-96b32ba9c3d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:35.623341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:35.624408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:35.625381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:35.627684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 16/28] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:35.628990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f860-263a-4757-8ce7-8f6630ea6b6f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.630150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f860-263a-4757-8ce7-8f6630ea6b6f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.630562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f860-263a-4757-8ce7-8f6630ea6b6f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.632451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 17/29] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:35.634906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f860-263a-4757-8ce7-8f6630ea6b6f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:35.671373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802433b-4b5e-4ae1-bc6e-58408eb27fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:35.672010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802433b-4b5e-4ae1-bc6e-58408eb27fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.672303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802433b-4b5e-4ae1-bc6e-58408eb27fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.672544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802433b-4b5e-4ae1-bc6e-58408eb27fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.683230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802433b-4b5e-4ae1-bc6e-58408eb27fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:35.684708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802433b-4b5e-4ae1-bc6e-58408eb27fc5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d802433b-4b5e-4ae1-bc6e-58408eb27fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:22:35.700456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:35.701658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:22:35.702545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:22:35.702545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:22:35.702545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:35.705805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 13/30] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:35.707119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e1e0-caed-40ce-9fe9-695600cc44e3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.707404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e1e0-caed-40ce-9fe9-695600cc44e3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.707674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e1e0-caed-40ce-9fe9-695600cc44e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.712780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:35.727531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-28c7e1e0-caed-40ce-9fe9-695600cc44e3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:35.728730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-28c7e1e0-caed-40ce-9fe9-695600cc44e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:35.762375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f860-263a-4757-8ce7-8f6630ea6b6f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:35.806301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:35.807820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.807992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 14/31] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:35.808702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.808975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e1e0-caed-40ce-9fe9-695600cc44e3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:35.809328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.810207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:35.810703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:35.812579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:35.822347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 18/32] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:35.823429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:35.870589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:35.934913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288f269-ef2d-47c0-afff-a0fe9348c501 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:35.969757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:35.972104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:35.973690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.977612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.977612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.977612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:35.977612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:35.977612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:35.995785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 19/33] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:35.997003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:36.025391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e1e0-caed-40ce-9fe9-695600cc44e3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:36.094268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:36.094907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.095263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.095461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.096151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:36.102524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:36.109282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee804-45e3-4a18-99a8-edadcfaa8b39 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:36.159951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:36.160899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.161347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.161833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] PATH_INFO: `/v3/users/7f29f71fcc134e71ac6d471453d847e2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.164102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] RBAC: Authorizing `identity:get_user(user_id=7f29f71fcc134e71ac6d471453d847e2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:36.165752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:36.167628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 20/34] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:35 2022] GET /identity/v3/users/7f29f71fcc134e71ac6d471453d847e2 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:36.168586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:36.226555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:36.267495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 15/35] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 30 00:22:35 2022] POST /identity/v3/roles => generated 225 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:36.268718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:36.282741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5e530-15a0-4ac8-a3f4-eba87e1db869 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:36.330644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e9060-3fc5-4384-87fe-ce47812e9efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:36.332164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e9060-3fc5-4384-87fe-ce47812e9efd None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.333127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e9060-3fc5-4384-87fe-ce47812e9efd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.333643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e9060-3fc5-4384-87fe-ce47812e9efd None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.334788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e9060-3fc5-4384-87fe-ce47812e9efd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:36.337316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e9060-3fc5-4384-87fe-ce47812e9efd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:36.393192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:36.408330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672620d-3f3d-42a6-997c-2bbea4f70388 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:36.451323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84654685-2be2-41f1-8064-722c82709728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:36.452308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84654685-2be2-41f1-8064-722c82709728 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.452785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84654685-2be2-41f1-8064-722c82709728 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.453287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84654685-2be2-41f1-8064-722c82709728 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.454061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84654685-2be2-41f1-8064-722c82709728 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:36.455613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84654685-2be2-41f1-8064-722c82709728 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:36.472685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 16/36] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 30 00:22:36 2022] POST /identity/v3/roles => generated 219 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:36.473321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84654685-2be2-41f1-8064-722c82709728 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:36.488103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 21/37] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:22:36 2022] POST /identity/v3/projects => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:36.491810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82350-f4e2-4e9f-9a7f-543a939673e4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.491810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82350-f4e2-4e9f-9a7f-543a939673e4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.491810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82350-f4e2-4e9f-9a7f-543a939673e4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.491810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 22/38] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:36.492899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf7ac-ab7c-48be-a951-d0eb4b5d0943 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.493091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf7ac-ab7c-48be-a951-d0eb4b5d0943 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.493356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cf7ac-ab7c-48be-a951-d0eb4b5d0943 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.499398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 23/39] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:36.500902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cdf55-5e92-4d4e-9f75-e44cf74c01b3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.501192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cdf55-5e92-4d4e-9f75-e44cf74c01b3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.501468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cdf55-5e92-4d4e-9f75-e44cf74c01b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.529760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9a4cdf55-5e92-4d4e-9f75-e44cf74c01b3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:36.531619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9a4cdf55-5e92-4d4e-9f75-e44cf74c01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:36.616449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84654685-2be2-41f1-8064-722c82709728 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:36.661090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11731-0588-4e9b-82ef-685784572bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:36.663419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11731-0588-4e9b-82ef-685784572bcb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.663419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11731-0588-4e9b-82ef-685784572bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.663419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11731-0588-4e9b-82ef-685784572bcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.665082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11731-0588-4e9b-82ef-685784572bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:36.667438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11731-0588-4e9b-82ef-685784572bcb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:36.668760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 17/40] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:36.671670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7874f1e-7d9d-4a14-9dba-448dd7e35ec7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.671670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7874f1e-7d9d-4a14-9dba-448dd7e35ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.671928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7874f1e-7d9d-4a14-9dba-448dd7e35ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.694508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c7874f1e-7d9d-4a14-9dba-448dd7e35ec7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:36.696467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c7874f1e-7d9d-4a14-9dba-448dd7e35ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:36.710218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:36.762269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 24/41] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:36.763038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cdf55-5e92-4d4e-9f75-e44cf74c01b3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:36.788460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 18/42] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:36.801865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:36.869635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cdf55-5e92-4d4e-9f75-e44cf74c01b3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:36.906313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:36.906993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:36.907277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:36.907551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] PATH_INFO: `/v3/domains/default/users/7f29f71fcc134e71ac6d471453d847e2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:36.909636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7f29f71fcc134e71ac6d471453d847e2, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:36.911212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:36.929620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1361 bytes} [Tue Aug 30 00:22:36 2022] PUT /identity/v3/domains/default/users/7f29f71fcc134e71ac6d471453d847e2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:37.029515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7874f1e-7d9d-4a14-9dba-448dd7e35ec7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:37.057737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:37.155885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7874f1e-7d9d-4a14-9dba-448dd7e35ec7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:37.166276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:37.173168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11093ac6-128a-4ee4-b93c-bc54d09c9739 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:37.195060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:37.195683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:37.196259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:37.196362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:37.196993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:37.198611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:37.211418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1daab-8caf-4b22-8f06-5320526fe32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:37.212303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1daab-8caf-4b22-8f06-5320526fe32a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:37.212608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1daab-8caf-4b22-8f06-5320526fe32a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:37.212916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1daab-8caf-4b22-8f06-5320526fe32a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:37.214080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1daab-8caf-4b22-8f06-5320526fe32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:37.215560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1daab-8caf-4b22-8f06-5320526fe32a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:37.215945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 19/44] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 30 00:22:37 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:37.217440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 26/45] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:37.223103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:37.233093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:37.337973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89474f-03b7-477f-b39e-13f02dff1599 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:37.376107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a729b2-bee8-44f6-9966-a76d7596a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:37.376740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a729b2-bee8-44f6-9966-a76d7596a2a1 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:37.377017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a729b2-bee8-44f6-9966-a76d7596a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:37.377283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a729b2-bee8-44f6-9966-a76d7596a2a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:37.377976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a729b2-bee8-44f6-9966-a76d7596a2a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:37.379753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a729b2-bee8-44f6-9966-a76d7596a2a1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:37.412679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 20/46] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:22:37 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:38.802377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebcb6-2fc1-488c-aa69-851f4c96fb05 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:38.802900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebcb6-2fc1-488c-aa69-851f4c96fb05 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:38.802900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaebcb6-2fc1-488c-aa69-851f4c96fb05 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:38.804279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 27/47] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:38.810819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7d7b-be1c-4c72-8c73-66abe251e81e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:38.811307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7d7b-be1c-4c72-8c73-66abe251e81e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:38.811772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7d7b-be1c-4c72-8c73-66abe251e81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:38.832386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-69ce7d7b-be1c-4c72-8c73-66abe251e81e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:38.833580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-69ce7d7b-be1c-4c72-8c73-66abe251e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:38.889169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:38.904246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:39.166682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaebcb6-2fc1-488c-aa69-851f4c96fb05 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.272554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaebcb6-2fc1-488c-aa69-851f4c96fb05 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.308038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.308670 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.308951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.309224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.316634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a192a7-d078-4d82-8854-674368a2e78b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.316950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a192a7-d078-4d82-8854-674368a2e78b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.317199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a192a7-d078-4d82-8854-674368a2e78b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.318668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 22/49] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:22:39.320399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:39.325361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:39.326255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:39.326998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 28/50] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:39.327622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870fe4-7fc2-4fc9-a8f7-010f7494d6d6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.327622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870fe4-7fc2-4fc9-a8f7-010f7494d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.327622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870fe4-7fc2-4fc9-a8f7-010f7494d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.332613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.345773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fb870fe4-7fc2-4fc9-a8f7-010f7494d6d6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:39.346980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fb870fe4-7fc2-4fc9-a8f7-010f7494d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:39.358912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:39.418922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 23/51] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:39.436761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ffcca-8353-49cd-b334-e3123f3a125b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.469620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.470231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.470510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.470779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.471454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:39.471758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:39.473152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:39.481525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 29/52] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:39.487422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb870fe4-7fc2-4fc9-a8f7-010f7494d6d6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.588437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb870fe4-7fc2-4fc9-a8f7-010f7494d6d6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.606086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:39.624948 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.625595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.625907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.626184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] PATH_INFO: `/v3/users/7f29f71fcc134e71ac6d471453d847e2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.627596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] RBAC: Authorizing `identity:get_user(user_id=7f29f71fcc134e71ac6d471453d847e2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:39.629086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:39.631049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 24/53] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:39 2022] GET /identity/v3/users/7f29f71fcc134e71ac6d471453d847e2 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:39.636778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.685569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.725863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:39.741305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6586-53dd-43ce-89cf-098ceb55c80a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.777553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.778314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.778648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.778968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.780315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:39.781841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:39.783459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 30/54] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:39.789412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20e5d2-bd6f-4be3-aa98-6dcbbc98b9b0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.789559 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.824597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.825239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.825519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.825871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.827018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:39.828524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:39.830163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 25/55] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:39.835724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.894342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:39.900845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b8fe-592a-44d6-9933-8ce531a31fd3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.935568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ea9c5-b369-400a-a324-16a8f938c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.936239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea9c5-b369-400a-a324-16a8f938c79e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.936453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea9c5-b369-400a-a324-16a8f938c79e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.936723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea9c5-b369-400a-a324-16a8f938c79e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.937447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ea9c5-b369-400a-a324-16a8f938c79e None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.domain.id=default, user.id=7f29f71fcc134e71ac6d471453d847e2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:39.937794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ea9c5-b369-400a-a324-16a8f938c79e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:39.939243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ea9c5-b369-400a-a324-16a8f938c79e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:39.941889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b171da-709e-468b-b250-2db9e972ce32 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.945092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 31/56] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Aug 30 00:22:39 2022] GET /identity/v3/role_assignments?user.id=7f29f71fcc134e71ac6d471453d847e2&scope.domain.id=default&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:39.979521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873df176-5569-49cb-ba44-7f394d0bf3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.980162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873df176-5569-49cb-ba44-7f394d0bf3c9 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.980443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873df176-5569-49cb-ba44-7f394d0bf3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.980719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873df176-5569-49cb-ba44-7f394d0bf3c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.981401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873df176-5569-49cb-ba44-7f394d0bf3c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:39.982958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873df176-5569-49cb-ba44-7f394d0bf3c9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:40.124402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 26/57] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Aug 30 00:22:39 2022] POST /identity/v3/projects => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:42.029337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45665431-c58f-4175-9dc8-472ec668fe76 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.030322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45665431-c58f-4175-9dc8-472ec668fe76 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.030322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45665431-c58f-4175-9dc8-472ec668fe76 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.032537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 32/58] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:42.037939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812629f-eb8b-4d84-8e8f-77365a2ed0e3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.038357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812629f-eb8b-4d84-8e8f-77365a2ed0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.038461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812629f-eb8b-4d84-8e8f-77365a2ed0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.058348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7812629f-eb8b-4d84-8e8f-77365a2ed0e3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:42.059548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7812629f-eb8b-4d84-8e8f-77365a2ed0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:42.128210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 27/59] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:42.395484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45665431-c58f-4175-9dc8-472ec668fe76 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.419104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:42.505743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45665431-c58f-4175-9dc8-472ec668fe76 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.556876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7282-9ac0-4fb1-8de4-327deed5644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.557713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7282-9ac0-4fb1-8de4-327deed5644e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.557989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7282-9ac0-4fb1-8de4-327deed5644e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.558256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7282-9ac0-4fb1-8de4-327deed5644e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.559523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f7282-9ac0-4fb1-8de4-327deed5644e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.561030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f7282-9ac0-4fb1-8de4-327deed5644e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.562653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 33/60] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:42.568517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812629f-eb8b-4d84-8e8f-77365a2ed0e3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.601880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:42.668138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812629f-eb8b-4d84-8e8f-77365a2ed0e3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.705740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7106f-2e7a-46de-bca0-270abd344985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.706339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7106f-2e7a-46de-bca0-270abd344985 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.706618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7106f-2e7a-46de-bca0-270abd344985 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.706888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7106f-2e7a-46de-bca0-270abd344985 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.707540 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7106f-2e7a-46de-bca0-270abd344985 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.708983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7106f-2e7a-46de-bca0-270abd344985 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.738307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 28/61] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:22:42 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:45.932160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a629975-d50f-4f84-a811-4a64ef71000a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:45.932686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a629975-d50f-4f84-a811-4a64ef71000a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:45.932686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a629975-d50f-4f84-a811-4a64ef71000a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:45.934102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 34/62] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:45.937029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcd54-84fb-4cab-a5fe-7d455c85b92f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:45.937436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcd54-84fb-4cab-a5fe-7d455c85b92f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:45.937620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcd54-84fb-4cab-a5fe-7d455c85b92f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:45.939205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 29/63] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:45.939651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec6516-ed85-4125-9179-a231590b4eca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:45.940003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec6516-ed85-4125-9179-a231590b4eca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:45.940288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec6516-ed85-4125-9179-a231590b4eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:45.943744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558e95-7198-4227-8209-e1a94ffd987a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:45.944237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558e95-7198-4227-8209-e1a94ffd987a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:45.944701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558e95-7198-4227-8209-e1a94ffd987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:45.964479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9d558e95-7198-4227-8209-e1a94ffd987a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:45.966030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9d558e95-7198-4227-8209-e1a94ffd987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:45.968304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d0ec6516-ed85-4125-9179-a231590b4eca None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:45.969485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d0ec6516-ed85-4125-9179-a231590b4eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:46.045480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:22:46.046981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048c056-9b67-4712-9a0b-8f815b0225d4 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.047273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048c056-9b67-4712-9a0b-8f815b0225d4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.047551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048c056-9b67-4712-9a0b-8f815b0225d4 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.049591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 31/65] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:46.054809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff438c-e791-4c11-9a93-d4fbb7c4981d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.055089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff438c-e791-4c11-9a93-d4fbb7c4981d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.055361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff438c-e791-4c11-9a93-d4fbb7c4981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.065356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 35/66] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:46.084286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5cff438c-e791-4c11-9a93-d4fbb7c4981d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:46.085482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5cff438c-e791-4c11-9a93-d4fbb7c4981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:46.112265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:46.179915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 32/67] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:46.252251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038b684-0624-488d-98e2-0eaf9b794215 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.252573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038b684-0624-488d-98e2-0eaf9b794215 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.252822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038b684-0624-488d-98e2-0eaf9b794215 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.254900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 36/68] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:46.270930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53b47-bd62-4029-a447-8742d4048e9c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.271220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53b47-bd62-4029-a447-8742d4048e9c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.271502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53b47-bd62-4029-a447-8742d4048e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.290097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e6a53b47-bd62-4029-a447-8742d4048e9c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:46.291305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e6a53b47-bd62-4029-a447-8742d4048e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:46.355836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038b684-0624-488d-98e2-0eaf9b794215 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:46.365530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 33/69] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:46.387821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:46.397218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53b47-bd62-4029-a447-8742d4048e9c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:46.504867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:46.509966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038b684-0624-488d-98e2-0eaf9b794215 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:46.525851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53b47-bd62-4029-a447-8742d4048e9c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:46.550719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f01a-bedd-4c5d-9203-d0d17f2131de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:46.551365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f01a-bedd-4c5d-9203-d0d17f2131de None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.551649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f01a-bedd-4c5d-9203-d0d17f2131de None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.551924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f01a-bedd-4c5d-9203-d0d17f2131de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.562626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f01a-bedd-4c5d-9203-d0d17f2131de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:46.565856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:46.566655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.567071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.567534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1c02f01a-bedd-4c5d-9203-d0d17f2131de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:46.567639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:46.568616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:46.569351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 37/70] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:46.570334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de85c1-d0a7-461e-a6f8-ab6ed38a3cdd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.570624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de85c1-d0a7-461e-a6f8-ab6ed38a3cdd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.570896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de85c1-d0a7-461e-a6f8-ab6ed38a3cdd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.576243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 38/71] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:46.576243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de85c1-d0a7-461e-a6f8-ab6ed38a3cdd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:46.588464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:46.597593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:46.598606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:22:46.599536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:46.602408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 34/72] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:22:46.603496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:46.658491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:46.682727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de85c1-d0a7-461e-a6f8-ab6ed38a3cdd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:46.705511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663adf3c-d510-4b31-a1c5-edb7398b9652 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:46.719169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4479-c54e-4dd9-a733-361c1382b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:46.719811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4479-c54e-4dd9-a733-361c1382b197 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.720090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4479-c54e-4dd9-a733-361c1382b197 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.720361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4479-c54e-4dd9-a733-361c1382b197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.731023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c4479-c54e-4dd9-a733-361c1382b197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6a1c4479-c54e-4dd9-a733-361c1382b197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:46.735859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:46.736857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:46.737681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 39/73] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:46.738304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8dce9-fffb-4c17-80db-ec6414a72777 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.738379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8dce9-fffb-4c17-80db-ec6414a72777 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.738766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8dce9-fffb-4c17-80db-ec6414a72777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.740695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:46.741322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.741779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.742060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.742741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:46.743050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:46.744444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:46.756722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-abd8dce9-fffb-4c17-80db-ec6414a72777 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:46.757882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-abd8dce9-fffb-4c17-80db-ec6414a72777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:46.758266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 35/74] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:46.762446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:46.766070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:46.831854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 40/75] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:46.832798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8dce9-fffb-4c17-80db-ec6414a72777 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:46.868898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b175a3-a751-4610-a9c6-fe3030c3f363 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:46.900359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:46.909479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:46.910142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.910421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.910692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.911367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:46.911674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:46.913073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:46.921632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 36/76] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:46.926585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:46.941574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8dce9-fffb-4c17-80db-ec6414a72777 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:46.975957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:46.976612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:46.977048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:46.977344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:46.988052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:46.993103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:46.993636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:46.994463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:46.995216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 41/77] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:46.995836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.035697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1aa8f-8fa1-4356-a326-a04fe1961fcd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.071098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.071748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.072055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.072449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.073126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:47.073433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.074864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.089289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 37/78] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:47.089289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.102957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee342-deb4-442b-888d-3c0b7dcd05d5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.127843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.137127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.137791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.138075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.138347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.151516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.152983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.157301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 42/79] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:46 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:47.157301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.193086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b88cd-8c50-464f-b31a-21cc2e2875fc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.221382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.229719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.230367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.230648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.230930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.232097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.233690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.235474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 38/80] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:47.236060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.267605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504bb6d-c1a4-4ba1-b4d5-0da9e660aea7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.300782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.301323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.301636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.301916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.302580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:47.302887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.304289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.312405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 43/81] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:47.313232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.339598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca90ec5-a59a-4713-88ce-df729b00af71 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.360898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.374252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.374887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.375165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.375436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] PATH_INFO: `/v3/users/7f29f71fcc134e71ac6d471453d847e2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.376715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] RBAC: Authorizing `identity:get_user(user_id=7f29f71fcc134e71ac6d471453d847e2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.378307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.380290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 39/82] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/users/7f29f71fcc134e71ac6d471453d847e2 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:47.381069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.421252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce073-4217-42ac-ba6b-cd85f4e0b24a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.444082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.454717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.455358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.455639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.455912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.457024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.458523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.460104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 44/83] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:47.460881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.487282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c0d60-b95b-4067-80ee-595710d85784 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.521486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.522121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.522410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.522682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.563671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627acd6-5272-4692-b4e7-d56074848ff5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.577819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.592693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.594211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.598551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.599160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.599440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.599712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.654965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.666643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.668130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.693937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 40/84] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:47.699009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.768309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 45/85] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:47.769086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.783222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.805655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4cac3-2ceb-4ce2-99b4-41b06fc0fdfe None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.839898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.840474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.840760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.841039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.842195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.843714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.845335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 41/86] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:47.846108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:47.865379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f31173-90a2-4050-806b-e9a3c89eb4e0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.876830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:47.900209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.900837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.901133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.901395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.943270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0c66-974e-4a5c-8bdf-f750948c68bc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:47.967470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.969048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.977609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:47.978213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:47.978498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:47.978773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:47.979424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:47.980872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:47.983080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:48.003479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 42/87] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:22:47 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:48.005186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.085745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 46/88] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:48.085745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.109604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:48.128770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d79a-d6c9-4ace-9518-391681d17d62 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:48.169996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:48.170705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:48.170993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:48.171271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:48.172426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:48.173926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:48.175762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 43/89] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:48.176355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.201093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd422e-ceba-49bc-a708-1d13b461715b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:48.217855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:48.247618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:48.248349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:48.248624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:48.248902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:48.250901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:48.252391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:48.255157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 47/90] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:48.255944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.304675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914025-533c-41fd-93f6-a5781914b85d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:48.339740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:48.340367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:48.340652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:48.340929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:48.372353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:48.372798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428eb9ae-4a7f-4730-b8b8-fd6de7b2b126 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:48.416248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:48.416894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:48.417177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:48.417448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:48.418618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:48.420603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:48.422816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 48/91] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:48.423556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.439412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:48.441741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:48.485672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:48.544591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e626ac-b8cc-430c-a4d4-c005e53a966f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:48.558826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 44/92] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:48.559659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.584213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:48.585264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:48.585850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:48.586417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:48.587439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=09756cf486814b05b937a688887b6c26) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:48.588064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:48.589731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:48.598563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/role_assignments?user.id=09756cf486814b05b937a688887b6c26&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:48.599834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.646205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:48.741402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fbb62-9f42-4d53-9acd-9a1e7cc84092 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:48.743621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8564ec-d0fe-4bf9-b7b2-3fe82ed0ce8a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:48.775800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:48.815028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:48.815800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:48.816253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:48.816441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:48.816702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:48.816975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:48.817310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:48.817805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:48.817918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] RBAC: Adding query filter params (role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=09756cf486814b05b937a688887b6c26) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:48.818170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:48.819042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=7f29f71fcc134e71ac6d471453d847e2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:48.819559 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:48.819656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:48.821391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:48.828378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 50/94] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/role_assignments?user.id=7f29f71fcc134e71ac6d471453d847e2&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:48.829434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:48.830943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 45/95] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/role_assignments?user.id=09756cf486814b05b937a688887b6c26&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:48.997722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9c42-4738-4b46-984d-19aa35ef8b48 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:49.046237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae969a-bcb6-4942-8b54-3f6e075e1c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:49.047331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae969a-bcb6-4942-8b54-3f6e075e1c39 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:49.047889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae969a-bcb6-4942-8b54-3f6e075e1c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:49.048381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae969a-bcb6-4942-8b54-3f6e075e1c39 None admin] PATH_INFO: `/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:49.054421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae969a-bcb6-4942-8b54-3f6e075e1c39 None admin] RBAC: Authorizing `identity:get_project(project_id=28819bafb0ef45f3ae7a7a6d469ac05a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:49.056248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae969a-bcb6-4942-8b54-3f6e075e1c39 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:49.058273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 51/96] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:48 2022] GET /identity/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:49.064466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:49.191186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260793a2-d09f-4bde-8442-9d20feba0bf1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:49.214376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:49.226600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b680a-2742-44b6-93de-06c62f18e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:49.227269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b680a-2742-44b6-93de-06c62f18e74a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:49.227550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b680a-2742-44b6-93de-06c62f18e74a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:49.227824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b680a-2742-44b6-93de-06c62f18e74a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:49.228563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b680a-2742-44b6-93de-06c62f18e74a None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=28819bafb0ef45f3ae7a7a6d469ac05a, user.id=09756cf486814b05b937a688887b6c26) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:49.228871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b680a-2742-44b6-93de-06c62f18e74a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:49.230358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b680a-2742-44b6-93de-06c62f18e74a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:49.236381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 46/97] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:22:49 2022] GET /identity/v3/role_assignments?user.id=09756cf486814b05b937a688887b6c26&scope.project.id=28819bafb0ef45f3ae7a7a6d469ac05a&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:50.792625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c356-268d-48d6-b5c8-f9c6b1007ebd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:50.793151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c356-268d-48d6-b5c8-f9c6b1007ebd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:50.793225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c356-268d-48d6-b5c8-f9c6b1007ebd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:50.794590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 52/98] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:50.799933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24a10-2338-425d-8210-f1025b71e141 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:50.800738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24a10-2338-425d-8210-f1025b71e141 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:50.801214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24a10-2338-425d-8210-f1025b71e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:50.816791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1e8a-06bb-4f0b-94c2-53f219f8ce6a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:50.817416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1e8a-06bb-4f0b-94c2-53f219f8ce6a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:50.817925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1e8a-06bb-4f0b-94c2-53f219f8ce6a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:50.819490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 53/99] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:22:50.824205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f6a24a10-2338-425d-8210-f1025b71e141 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:50.824937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e51b1d-4dc4-45d8-9c3b-6898220476dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:50.825430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f6a24a10-2338-425d-8210-f1025b71e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:50.825672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e51b1d-4dc4-45d8-9c3b-6898220476dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:50.826128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e51b1d-4dc4-45d8-9c3b-6898220476dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:50.850309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f5e51b1d-4dc4-45d8-9c3b-6898220476dd None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:50.852662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f5e51b1d-4dc4-45d8-9c3b-6898220476dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:50.915912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:50.949323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 54/100] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:22:50.999247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 47/101] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:51.427408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d4ff-f3df-416a-9563-12e262d2a738 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.428104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d4ff-f3df-416a-9563-12e262d2a738 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.428618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d4ff-f3df-416a-9563-12e262d2a738 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.430248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 55/102] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:51.436367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee41619-8276-4cd1-a2f6-e8928f96da5a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.436999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee41619-8276-4cd1-a2f6-e8928f96da5a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.437470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee41619-8276-4cd1-a2f6-e8928f96da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.462080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fee41619-8276-4cd1-a2f6-e8928f96da5a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:51.463654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fee41619-8276-4cd1-a2f6-e8928f96da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:51.479993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194d4ff-f3df-416a-9563-12e262d2a738 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:51.557080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 48/103] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:22:51.558673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179494e-3938-40de-b90d-c914f51c2937 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.558963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179494e-3938-40de-b90d-c914f51c2937 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.559256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179494e-3938-40de-b90d-c914f51c2937 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.560694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 49/104] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:51.561413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179494e-3938-40de-b90d-c914f51c2937 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:51.624823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194d4ff-f3df-416a-9563-12e262d2a738 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:51.659603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:51.691949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7284-fefd-43af-9836-7478be382de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:51.692599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7284-fefd-43af-9836-7478be382de7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.692875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7284-fefd-43af-9836-7478be382de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7284-fefd-43af-9836-7478be382de7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.694303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7284-fefd-43af-9836-7478be382de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:51.695956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7284-fefd-43af-9836-7478be382de7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:51.697699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 56/105] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:51.703530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4011f-7d4d-47a6-9626-e2628a84c50f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.704273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4011f-7d4d-47a6-9626-e2628a84c50f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.704719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4011f-7d4d-47a6-9626-e2628a84c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.726536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-26f4011f-7d4d-47a6-9626-e2628a84c50f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:51.728429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26f4011f-7d4d-47a6-9626-e2628a84c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:51.765912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179494e-3938-40de-b90d-c914f51c2937 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:51.805314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:51.822566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c6648-b56e-435c-ad26-a6a03b09271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:51.823780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6648-b56e-435c-ad26-a6a03b09271f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.824221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6648-b56e-435c-ad26-a6a03b09271f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.824620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c6648-b56e-435c-ad26-a6a03b09271f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.836011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c6648-b56e-435c-ad26-a6a03b09271f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:51.839488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 57/106] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:51.840682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4011f-7d4d-47a6-9626-e2628a84c50f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-bb7c6648-b56e-435c-ad26-a6a03b09271f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:51.841187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:51.842239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:22:51.843010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:51.845279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 50/107] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:51.847255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b9b0c-bceb-4e7d-912e-a043d6790160 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.847748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b9b0c-bceb-4e7d-912e-a043d6790160 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.848203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b9b0c-bceb-4e7d-912e-a043d6790160 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.849667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 51/108] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:51.850545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b9b0c-bceb-4e7d-912e-a043d6790160 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:51.953915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4011f-7d4d-47a6-9626-e2628a84c50f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:51.955513 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b9b0c-bceb-4e7d-912e-a043d6790160 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:51.957986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:51.992122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:51.992805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.993078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.993196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b43b2-32b3-45b2-9b34-7a0d9367d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:51.993368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.993838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b43b2-32b3-45b2-9b34-7a0d9367d14c None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:51.994105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b43b2-32b3-45b2-9b34-7a0d9367d14c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:51.994379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b43b2-32b3-45b2-9b34-7a0d9367d14c None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:51.995024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b43b2-32b3-45b2-9b34-7a0d9367d14c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:51.996525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b43b2-32b3-45b2-9b34-7a0d9367d14c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:52.004676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:52.010368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:52.011216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 52/109] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:22:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:52.012452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.031876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 58/110] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:22:51 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:52.035052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a990b9-7f35-41c8-b48c-05b7aaeddcf4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.036162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a990b9-7f35-41c8-b48c-05b7aaeddcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.036724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a990b9-7f35-41c8-b48c-05b7aaeddcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.065537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-68a990b9-7f35-41c8-b48c-05b7aaeddcf4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:52.067886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-68a990b9-7f35-41c8-b48c-05b7aaeddcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:52.093724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:52.136737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64dd79-9229-4a4c-828e-f4f071a39cb1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.153771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 59/111] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:52.159132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6798b-b7be-495d-97b8-b365a7b20161 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.160321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6798b-b7be-495d-97b8-b365a7b20161 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.160787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6798b-b7be-495d-97b8-b365a7b20161 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.162722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 60/112] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:52.163977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6798b-b7be-495d-97b8-b365a7b20161 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.193169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.194131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.194410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.194683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.195354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:52.195654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:52.197047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:52.206405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 53/113] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:52.207163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.243642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:52.285361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6798b-b7be-495d-97b8-b365a7b20161 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.320377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7671ac-5e35-4480-aeb2-60f0e0c70d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.320988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7671ac-5e35-4480-aeb2-60f0e0c70d73 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.321263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7671ac-5e35-4480-aeb2-60f0e0c70d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.321529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7671ac-5e35-4480-aeb2-60f0e0c70d73 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.322238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7671ac-5e35-4480-aeb2-60f0e0c70d73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:52.322540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7671ac-5e35-4480-aeb2-60f0e0c70d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:52.323925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7671ac-5e35-4480-aeb2-60f0e0c70d73 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:52.332509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 61/114] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:52.333801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3d1e-ca38-4e2f-8ba7-85282c4b4ce7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.334084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3d1e-ca38-4e2f-8ba7-85282c4b4ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.334355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3d1e-ca38-4e2f-8ba7-85282c4b4ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.338769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595994f3-5373-4840-98be-bc18d37a6ff4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.355048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e1de3d1e-ca38-4e2f-8ba7-85282c4b4ce7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:52.356600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e1de3d1e-ca38-4e2f-8ba7-85282c4b4ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:52.375891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:52.380401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.381233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.381689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.382095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.395872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:52.401822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:52.402632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:52.403365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:52.405962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 54/115] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:52.406979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.453579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 62/116] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:52.453579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3d1e-ca38-4e2f-8ba7-85282c4b4ce7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.531130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:52.553416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9983d-3421-4a9c-81c1-9eaebf0e7e15 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.558653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3d1e-ca38-4e2f-8ba7-85282c4b4ce7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.589327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.590000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.590331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.590606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] PATH_INFO: `/v3/users/54ff5da3962448b8a679687c89a72b50` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.601634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.602786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.603207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.603615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.605338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:52.607517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:52.607814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] RBAC: Authorizing `identity:get_user(user_id=54ff5da3962448b8a679687c89a72b50)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:52.609438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:52.609749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 63/117] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:52.610781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.611379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 55/118] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/users/54ff5da3962448b8a679687c89a72b50 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:52.612186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.635110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:52.722106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e5ea9-77f5-4f07-9171-7368fb84a92b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.743197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d77a2-b767-4055-b0b1-4e4969c0340b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.759773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.760674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.761202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.761682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.772883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:52.778102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:52.779083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:52.780094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:52.780832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.780832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.780832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.780832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.781127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:52.781338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:52.782641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 56/119] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:52.782738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:52.784173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.788691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:52.793912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 64/120] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:52.799268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:52.878877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:52.902157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fa70-e0ff-4660-9755-8dc28842891b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.904490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e89b2-8f04-4818-9ef3-b78c232aec46 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:52.938537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.939216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.939501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.939775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.940035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:52.940690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:52.940915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:52.941007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:52.941336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:52.942408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:52.949097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 65/121] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:52.949097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.016599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.018244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.021326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.054222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17892177-c42d-406c-b6f1-d16cb051ea34 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.088540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.089180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.089472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.089762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.100442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:53.105770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:53.106618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:53.107425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:53.110001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 66/122] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:53.111125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.119946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.141520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 57/123] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:53.142492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.221297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac76d6c-ac5a-4836-9c34-bba546830f2f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.253926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1789-10be-464b-9cf9-dc9dc4964b52 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.257917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.261861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.262489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.262772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.263042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.263798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:53.264089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.265499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.274389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 67/124] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:53.275009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.297831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.298978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.299532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.299813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] PATH_INFO: `/v3/users/7f29f71fcc134e71ac6d471453d847e2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.300935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] RBAC: Authorizing `identity:get_user(user_id=7f29f71fcc134e71ac6d471453d847e2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.302520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.304146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 58/125] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/users/7f29f71fcc134e71ac6d471453d847e2 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:53.305038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.350776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.395626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92f7e8-20ec-443b-88d4-0f6aecf131d4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.421440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adef44-b3ec-440b-abac-bbc8fb9d5e51 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.436489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.437508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.438017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.438532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/09756cf486814b05b937a688887b6c26/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.441022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa951d1ef5d7477b8a715daf4ec64377, user_id=09756cf486814b05b937a688887b6c26, role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.442857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.456840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.457466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.457778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.458052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.458201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 68/126] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:22:53 2022] PUT /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/09756cf486814b05b937a688887b6c26/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:53.459277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.462515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:53.464387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.466211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.478695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 59/127] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:53.480274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.536381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.589079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151e6ca-7e94-4674-a6b2-22e4b5b0fac1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.624726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.631698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c2f61-3025-46e9-af1d-28527940c062 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.636918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.637070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.637305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.639070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.642541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.643771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.649654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 69/128] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:53.649654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.683331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.684327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.685003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.685497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.687589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.689503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.692334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 60/129] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:53.693340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.777593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452d732-a1df-4187-bd32-7bea65f6812a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.815238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.815886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.816271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.816637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.817933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.819589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.825902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 70/130] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:53.825902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.840432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae60c9-38f8-4d1f-8275-f9b79e4c4ceb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.842661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.879491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8459556-139b-4621-8994-099f82e25418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.880139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459556-139b-4621-8994-099f82e25418 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.880418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459556-139b-4621-8994-099f82e25418 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.880691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459556-139b-4621-8994-099f82e25418 None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.881858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8459556-139b-4621-8994-099f82e25418 None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.883329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8459556-139b-4621-8994-099f82e25418 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.889624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 61/131] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:53.889624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8459556-139b-4621-8994-099f82e25418 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.917101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:53.966501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66577-84c1-4692-9be6-445a8a83ab46 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:54.002609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8459556-139b-4621-8994-099f82e25418 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:54.004850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:54.005662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.006042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.006433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.007338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] RBAC: Adding query filter params (role.id=fa61aa1209a54a50b96d3280153e0485, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=54ff5da3962448b8a679687c89a72b50) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:54.007692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:54.009227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:54.015711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 71/132] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/role_assignments?user.id=54ff5da3962448b8a679687c89a72b50&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=fa61aa1209a54a50b96d3280153e0485 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:54.016734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:54.048517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:54.049619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.050102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.050573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.052096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:54.054068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:54.056078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 62/133] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:54.057092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:54.111254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:54.164056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122709c1-1e37-4d2d-95f1-e1cb64807b91 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:54.186928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e7640-cff2-4d42-9ff0-e790868e0c78 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:54.196969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:54.205490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e004ee-97b9-46ee-a80d-a23600a96cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:54.206290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e004ee-97b9-46ee-a80d-a23600a96cc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.206581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e004ee-97b9-46ee-a80d-a23600a96cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.206862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e004ee-97b9-46ee-a80d-a23600a96cc7 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/7f29f71fcc134e71ac6d471453d847e2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.208910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e004ee-97b9-46ee-a80d-a23600a96cc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa951d1ef5d7477b8a715daf4ec64377, user_id=7f29f71fcc134e71ac6d471453d847e2, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:54.210507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e004ee-97b9-46ee-a80d-a23600a96cc7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:54.228208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 72/134] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:22:54 2022] PUT /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/7f29f71fcc134e71ac6d471453d847e2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:54.229870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc719c55-4572-4931-9638-701ee4023d19 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.230425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc719c55-4572-4931-9638-701ee4023d19 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.230763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc719c55-4572-4931-9638-701ee4023d19 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.233112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 73/135] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:54.233795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc719c55-4572-4931-9638-701ee4023d19 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:54.237451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6be843-6ef3-4273-8bca-ffefe4a95d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:54.238548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be843-6ef3-4273-8bca-ffefe4a95d0d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.238969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be843-6ef3-4273-8bca-ffefe4a95d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.239367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6be843-6ef3-4273-8bca-ffefe4a95d0d None admin] PATH_INFO: `/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.240835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6be843-6ef3-4273-8bca-ffefe4a95d0d None admin] RBAC: Authorizing `identity:get_project(project_id=28819bafb0ef45f3ae7a7a6d469ac05a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:54.242651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6be843-6ef3-4273-8bca-ffefe4a95d0d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:54.244825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 63/136] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:54 2022] GET /identity/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:54.246329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee116-065a-4c24-843d-448f919af925 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.246758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee116-065a-4c24-843d-448f919af925 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.247118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee116-065a-4c24-843d-448f919af925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.269909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5f8ee116-065a-4c24-843d-448f919af925 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:54.271364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5f8ee116-065a-4c24-843d-448f919af925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:54.367773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc719c55-4572-4931-9638-701ee4023d19 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:54.417010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:54.417893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.418183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.418467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/09756cf486814b05b937a688887b6c26/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.420658 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa951d1ef5d7477b8a715daf4ec64377, user_id=09756cf486814b05b937a688887b6c26, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:54.422601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:54.433413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 64/137] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:54.434216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ee116-065a-4c24-843d-448f919af925 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:54.446347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 74/138] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:22:54 2022] PUT /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/09756cf486814b05b937a688887b6c26/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:54.494722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:54.583494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ee116-065a-4c24-843d-448f919af925 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:54.633943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:54.634554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.634837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.635113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] PATH_INFO: `/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a/users/09756cf486814b05b937a688887b6c26/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.638899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] RBAC: Authorizing `identity:create_grant(project_id=28819bafb0ef45f3ae7a7a6d469ac05a, user_id=09756cf486814b05b937a688887b6c26, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:54.640539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:54.660972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 65/139] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:22:54 2022] PUT /identity/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a/users/09756cf486814b05b937a688887b6c26/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:54.765669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:54.832315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:54.887715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bfa2-2fcf-4b3f-9b4d-ac0164515ff0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:54.927514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373657e-4300-480e-8326-a20a8b9322e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:54.928169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373657e-4300-480e-8326-a20a8b9322e5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:54.928435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373657e-4300-480e-8326-a20a8b9322e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:54.928706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373657e-4300-480e-8326-a20a8b9322e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:54.929858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373657e-4300-480e-8326-a20a8b9322e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:54.931399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373657e-4300-480e-8326-a20a8b9322e5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:54.933200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 75/140] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:54.939302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:55.066000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:55.068890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd76d-72fd-4ac3-a9ba-14c5e29f3b22 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:55.104559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd037a8-6538-4658-b174-649ab5b0ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:55.105183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd037a8-6538-4658-b174-649ab5b0ac93 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:55.105466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd037a8-6538-4658-b174-649ab5b0ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:55.105777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd037a8-6538-4658-b174-649ab5b0ac93 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:55.106435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd037a8-6538-4658-b174-649ab5b0ac93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:55.107923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd037a8-6538-4658-b174-649ab5b0ac93 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:55.133010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 66/141] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:22:54 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:56.048089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf02c-4320-4752-b398-69a022011b7c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:56.048890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf02c-4320-4752-b398-69a022011b7c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:56.048890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf02c-4320-4752-b398-69a022011b7c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:56.050446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 76/142] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:56.058687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1300c-2cd7-45d2-8217-c4824a231d5c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:56.059065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1300c-2cd7-45d2-8217-c4824a231d5c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:56.059319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1300c-2cd7-45d2-8217-c4824a231d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:56.084799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4db1300c-2cd7-45d2-8217-c4824a231d5c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:56.086063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4db1300c-2cd7-45d2-8217-c4824a231d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:56.166601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 67/143] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:56.735653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf02c-4320-4752-b398-69a022011b7c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:56.854007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf02c-4320-4752-b398-69a022011b7c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:56.873597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:56.894999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e3a8d-5e28-4de0-9535-37b95e93ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:56.895650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e3a8d-5e28-4de0-9535-37b95e93ba63 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:56.895925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e3a8d-5e28-4de0-9535-37b95e93ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:56.896191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e3a8d-5e28-4de0-9535-37b95e93ba63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:56.912636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e3a8d-5e28-4de0-9535-37b95e93ba63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a76e3a8d-5e28-4de0-9535-37b95e93ba63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:56.917498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:56.918376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:56.919613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 77/144] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:56.925209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1300c-2cd7-45d2-8217-c4824a231d5c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:56.970286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af37d36-5284-40f9-838b-921de36aab85 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:56.970599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af37d36-5284-40f9-838b-921de36aab85 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:56.970824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af37d36-5284-40f9-838b-921de36aab85 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:56.972507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 78/145] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:56.977481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b500e-261c-4360-8f10-2e2d41291263 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:56.977828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b500e-261c-4360-8f10-2e2d41291263 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:56.978100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b500e-261c-4360-8f10-2e2d41291263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.003909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3d7b500e-261c-4360-8f10-2e2d41291263 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:57.005382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3d7b500e-261c-4360-8f10-2e2d41291263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:57.075500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:57.089937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 79/146] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:22:57.091127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4241-739c-46c3-8ef1-8fda87cf7bd6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.092354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4241-739c-46c3-8ef1-8fda87cf7bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.092731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4241-739c-46c3-8ef1-8fda87cf7bd6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.095755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 80/147] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:57.102764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f5bec-3a23-4878-a363-0774c594a87e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.103850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f5bec-3a23-4878-a363-0774c594a87e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.104831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f5bec-3a23-4878-a363-0774c594a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.112918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1300c-2cd7-45d2-8217-c4824a231d5c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:57.136706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0c0f5bec-3a23-4878-a363-0774c594a87e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:57.137931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c0f5bec-3a23-4878-a363-0774c594a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:57.191578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:57.192229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.193322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.193773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.194589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:57.203192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:57.203682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:57.219913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 68/148] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:57.230620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:57.234102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 81/149] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:22:57.419813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004c80-68b2-4c31-8afa-de0d86417161 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:57.462349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:57.463045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.463329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.463604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.464836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:57.466415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:57.468251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 69/150] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:57 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:57.474839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f5bec-3a23-4878-a363-0774c594a87e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:57.478618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:57.494104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:57.564863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:57.647897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbffbe-384a-455b-82ad-57e618145941 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:57.690035 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f5bec-3a23-4878-a363-0774c594a87e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:57.713656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:57.714808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.716143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.716653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.739135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:57.745523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:57.746384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:57.747179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:57.754698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68cb67-a582-4e3d-9cb2-27d45813e3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:57.755600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68cb67-a582-4e3d-9cb2-27d45813e3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.756065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68cb67-a582-4e3d-9cb2-27d45813e3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.756517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68cb67-a582-4e3d-9cb2-27d45813e3e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.757476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 70/151] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:22:57.758575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:57.860906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68cb67-a582-4e3d-9cb2-27d45813e3e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:57.862564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68cb67-a582-4e3d-9cb2-27d45813e3e1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:57.871226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:57.899962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:57.931026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bc9e1-7478-43de-bfda-8bf0c685d989 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:57.974617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 82/152] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:57.975728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f770-76b1-4087-9da8-d36076c4dd78 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.976216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f770-76b1-4087-9da8-d36076c4dd78 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.976636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f770-76b1-4087-9da8-d36076c4dd78 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:57.978139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 83/153] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:57.979023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f770-76b1-4087-9da8-d36076c4dd78 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:57.992970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:57.993696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:57.994120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:57.994606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.009891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:58.019867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:58.020701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:22:58.021434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:58.022183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 71/154] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:58.023304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:58.196369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f770-76b1-4087-9da8-d36076c4dd78 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:58.228916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518190f-c783-4276-b3e1-a7807e00b90f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:58.262219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a3ac5-8e0c-495a-8fc8-3e9950d40432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:58.262838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3ac5-8e0c-495a-8fc8-3e9950d40432 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.263114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3ac5-8e0c-495a-8fc8-3e9950d40432 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.263382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3ac5-8e0c-495a-8fc8-3e9950d40432 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.264124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a3ac5-8e0c-495a-8fc8-3e9950d40432 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:58.264423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a3ac5-8e0c-495a-8fc8-3e9950d40432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:58.265898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a3ac5-8e0c-495a-8fc8-3e9950d40432 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:58.273034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:58.283161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 84/155] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:58.287146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab3c5-b53b-40a0-b6f9-473cdbfb3633 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.288741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab3c5-b53b-40a0-b6f9-473cdbfb3633 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.289034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ab3c5-b53b-40a0-b6f9-473cdbfb3633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.292651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:58.301185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:58.301858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.302133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.302393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.304331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:58.306126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:58.308092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 72/156] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:58 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:58.309069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:58.315930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d22ab3c5-b53b-40a0-b6f9-473cdbfb3633 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:58.317146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d22ab3c5-b53b-40a0-b6f9-473cdbfb3633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:58.421676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9beb9-f3ca-4eb8-ab53-6c007b935ebc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:58.457151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5b1f9-a72a-4ad2-89a1-0aae6567bf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:58.458161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5b1f9-a72a-4ad2-89a1-0aae6567bf90 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.458697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5b1f9-a72a-4ad2-89a1-0aae6567bf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.459168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5b1f9-a72a-4ad2-89a1-0aae6567bf90 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.460017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5b1f9-a72a-4ad2-89a1-0aae6567bf90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:58.460500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5b1f9-a72a-4ad2-89a1-0aae6567bf90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:58.462127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5b1f9-a72a-4ad2-89a1-0aae6567bf90 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:58.471538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 73/157] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:58.473303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4be25-9a0d-4746-9ebb-4366e1e52586 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.473802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4be25-9a0d-4746-9ebb-4366e1e52586 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.474261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4be25-9a0d-4746-9ebb-4366e1e52586 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.475962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 74/158] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:58.477283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4be25-9a0d-4746-9ebb-4366e1e52586 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:58.499044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 85/159] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:58.499981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ab3c5-b53b-40a0-b6f9-473cdbfb3633 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:58.574038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:58.614433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4be25-9a0d-4746-9ebb-4366e1e52586 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:58.660164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:58.661362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.661897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.662453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.664315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:58.666083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:58.668694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 75/160] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:58 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:58.670343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:58.787181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7f0ab-21ef-49eb-8a39-e0e606e0a623 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:58.824737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21363ce-0a57-49ec-969c-8a4396752eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:58.825773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21363ce-0a57-49ec-969c-8a4396752eef None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.826298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21363ce-0a57-49ec-969c-8a4396752eef None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.827136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21363ce-0a57-49ec-969c-8a4396752eef None admin] PATH_INFO: `/v3/users/54ff5da3962448b8a679687c89a72b50` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.828484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21363ce-0a57-49ec-969c-8a4396752eef None admin] RBAC: Authorizing `identity:get_user(user_id=54ff5da3962448b8a679687c89a72b50)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:58.830325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21363ce-0a57-49ec-969c-8a4396752eef None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:58.832538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 76/161] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:58 2022] GET /identity/v3/users/54ff5da3962448b8a679687c89a72b50 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:58.832810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:58.833003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ab3c5-b53b-40a0-b6f9-473cdbfb3633 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:58.837022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d47e1-ac4b-4971-ad51-f76e8d8643f9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.838600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d47e1-ac4b-4971-ad51-f76e8d8643f9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.839172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d47e1-ac4b-4971-ad51-f76e8d8643f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.862486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-218d47e1-ac4b-4971-ad51-f76e8d8643f9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:58.864146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-218d47e1-ac4b-4971-ad51-f76e8d8643f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:58.890549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:58.900779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:58.901429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:58.901765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:58.902125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:58.902957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] RBAC: Adding query filter params (role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=09756cf486814b05b937a688887b6c26) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:58.903314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:58.904859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:58.911355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 86/162] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:22:58 2022] GET /identity/v3/role_assignments?user.id=09756cf486814b05b937a688887b6c26&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 608 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:58.912512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:58.958506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 77/163] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:58.965565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d47e1-ac4b-4971-ad51-f76e8d8643f9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:59.081844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4845b-8128-4bb3-b10b-2009c452c50b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:59.131863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d47e1-ac4b-4971-ad51-f76e8d8643f9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:59.170615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:59.171969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.172535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.173038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.174998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:59.176817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:59.179669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 78/164] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:58 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:59.179828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:59.180926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:59.210874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:59.211566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.212012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.212441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.304202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc490130-84f6-4b9f-bc1b-cfc55320e5b0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:59.347483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:59.348212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.348585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.348950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.362599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:59.368747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:59.369829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:22:59.370723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:22:59.374088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 79/165] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:59.375392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:59.427009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:59.443059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:59.462382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:59.464215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:59.499701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7d205-8d2f-4eb7-9dac-7ecee208e673 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:59.545219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f19aa-02fb-4cf8-9c8c-515044eab88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:59.546003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f19aa-02fb-4cf8-9c8c-515044eab88e None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.546469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f19aa-02fb-4cf8-9c8c-515044eab88e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.546895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f19aa-02fb-4cf8-9c8c-515044eab88e None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/54ff5da3962448b8a679687c89a72b50/roles/fa61aa1209a54a50b96d3280153e0485` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.549638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f19aa-02fb-4cf8-9c8c-515044eab88e None admin] RBAC: Authorizing `identity:create_grant(project_id=aa951d1ef5d7477b8a715daf4ec64377, user_id=54ff5da3962448b8a679687c89a72b50, role_id=fa61aa1209a54a50b96d3280153e0485)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:59.551728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f19aa-02fb-4cf8-9c8c-515044eab88e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:59.571088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 80/166] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:22:59 2022] PUT /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/users/54ff5da3962448b8a679687c89a72b50/roles/fa61aa1209a54a50b96d3280153e0485 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:59.573189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f924-19ee-495b-baa7-fd192e3cc1b5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.573997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f924-19ee-495b-baa7-fd192e3cc1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.574474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f924-19ee-495b-baa7-fd192e3cc1b5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.577016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 81/167] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:22:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:22:59.578403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8f924-19ee-495b-baa7-fd192e3cc1b5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:59.586849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 87/168] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:22:59.588178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:59.714097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:59.722359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8f924-19ee-495b-baa7-fd192e3cc1b5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:59.726425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68ee3-8735-49dc-8c92-8f7cd7c80e84 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:59.744725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:59.774803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:59.774803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.775130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.775209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.776230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d775-473d-4160-b6c7-e47dc86fa285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:59.777681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d775-473d-4160-b6c7-e47dc86fa285 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.778172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d775-473d-4160-b6c7-e47dc86fa285 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.778640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d775-473d-4160-b6c7-e47dc86fa285 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.779579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d775-473d-4160-b6c7-e47dc86fa285 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:59.780111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d775-473d-4160-b6c7-e47dc86fa285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:59.783117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d775-473d-4160-b6c7-e47dc86fa285 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:59.790083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:22:59.794524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 82/169] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:22:59.795758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:22:59.796716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:22:59.797556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 88/170] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:22:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:22:59.798243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:59.799715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e474a-1956-4140-b006-b461f2475ac0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.800227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e474a-1956-4140-b006-b461f2475ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.800697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e474a-1956-4140-b006-b461f2475ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.825219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-952e474a-1956-4140-b006-b461f2475ac0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:59.826991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-952e474a-1956-4140-b006-b461f2475ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:59.905869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 83/171] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:22:59.905869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e474a-1956-4140-b006-b461f2475ac0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:59.927621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1137950-52e1-4476-a62f-050c764b47b1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:59.979446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:59.980023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:59.980556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:59.980836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:59.982673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:59.984698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:59.987295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 89/172] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:22:59 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:59.988163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.012562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.031871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e474a-1956-4140-b006-b461f2475ac0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.044902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.078384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb834d-8520-44c0-a3ea-87cc1cb48b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.079041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb834d-8520-44c0-a3ea-87cc1cb48b8d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.079693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb834d-8520-44c0-a3ea-87cc1cb48b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.080157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb834d-8520-44c0-a3ea-87cc1cb48b8d None admin] PATH_INFO: `/v3/users/7f29f71fcc134e71ac6d471453d847e2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.081602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb834d-8520-44c0-a3ea-87cc1cb48b8d None admin] RBAC: Authorizing `identity:get_user(user_id=7f29f71fcc134e71ac6d471453d847e2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:00.083528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb834d-8520-44c0-a3ea-87cc1cb48b8d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:00.085173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 84/173] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:22:59 2022] GET /identity/v3/users/7f29f71fcc134e71ac6d471453d847e2 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:00.086442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8031234-6142-49c0-be44-d1646a94680a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.086782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8031234-6142-49c0-be44-d1646a94680a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.087057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8031234-6142-49c0-be44-d1646a94680a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.093316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 85/174] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:00.094954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613373-f34b-47c5-a502-4a6619e04a26 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.095241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613373-f34b-47c5-a502-4a6619e04a26 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.095513 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613373-f34b-47c5-a502-4a6619e04a26 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.097296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 86/175] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:00.098470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613373-f34b-47c5-a502-4a6619e04a26 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.110556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd6c2e-7cd0-49f5-becf-fc55a156394a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.155624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.156553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.157497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.158124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.158825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:00.159135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:00.161130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:00.178392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 90/176] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:22:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:00.179613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.222659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613373-f34b-47c5-a502-4a6619e04a26 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.259055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e61ecd-7f1f-424c-a77f-b5b83f93ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.259573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e61ecd-7f1f-424c-a77f-b5b83f93ab15 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.259849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e61ecd-7f1f-424c-a77f-b5b83f93ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.260119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e61ecd-7f1f-424c-a77f-b5b83f93ab15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.260921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e61ecd-7f1f-424c-a77f-b5b83f93ab15 None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=09756cf486814b05b937a688887b6c26) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:00.261227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e61ecd-7f1f-424c-a77f-b5b83f93ab15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:00.262741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e61ecd-7f1f-424c-a77f-b5b83f93ab15 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:00.277577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 87/177] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:00 2022] GET /identity/v3/role_assignments?user.id=09756cf486814b05b937a688887b6c26&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:00.277577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759d7b-1d97-4b60-8d8d-4e538836df8e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.277577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759d7b-1d97-4b60-8d8d-4e538836df8e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.277577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759d7b-1d97-4b60-8d8d-4e538836df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.278903 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.302828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2c759d7b-1d97-4b60-8d8d-4e538836df8e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:00.303180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79791621-a6fd-4885-bf03-240b6f1065b9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.304179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2c759d7b-1d97-4b60-8d8d-4e538836df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:00.342766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.343443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.343993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.381381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.395219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 88/178] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:00.397046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886477-59af-48d7-9d88-cf09efd27ab2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.397577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886477-59af-48d7-9d88-cf09efd27ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.398056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886477-59af-48d7-9d88-cf09efd27ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.418249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-71886477-59af-48d7-9d88-cf09efd27ab2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:00.419422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:00.420146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-71886477-59af-48d7-9d88-cf09efd27ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:00.421031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:00.503522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 89/179] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:00.505295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886477-59af-48d7-9d88-cf09efd27ab2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.505853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.538581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 91/180] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:00.539386 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.637336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.641479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886477-59af-48d7-9d88-cf09efd27ab2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.671446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911cd33-ec77-4b13-a2d8-28825a785854 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.686097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.686770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.687046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.687313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] PATH_INFO: `/v3/users/09756cf486814b05b937a688887b6c26` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.688545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] RBAC: Authorizing `identity:get_user(user_id=09756cf486814b05b937a688887b6c26)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:00.690026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:00.692142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 90/181] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:00 2022] GET /identity/v3/users/09756cf486814b05b937a688887b6c26 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:00.692974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.719087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.720181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.720659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.721133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.737600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:00.747003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:00.747938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:00.748759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:00.751171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 92/182] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:00.752322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.806684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584d039-c78b-4b16-a5a5-4d3735cef18f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.810442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.847796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.848770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.849229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.849718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.851217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:00.852890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:00.855067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 91/183] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:00 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:00.856329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:00.885093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288057a8-221f-4c92-b9a8-22ccc574beba None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.899025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:00.920704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:00.921328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:00.921640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:00.921914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:00.973648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcb7b9-9a0c-4667-aea3-1f5002d0eeaa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:00.993626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:00.995113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.012041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.012756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.013038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.013308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.014166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:01.014447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.015832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.029208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 92/184] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:01.029208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.043994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:01.109356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 93/185] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:01.110166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.133314 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:01.138199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a51183-90a2-4e4d-a0c5-382581b4c829 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.176700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.177498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.177814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.178081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.188866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:01.194161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:01.195042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 93/186] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:01.198490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.225054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0daa54-0caf-48dd-8e56-1d8b301a2572 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.261485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.262214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.262497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.262771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.263560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=7f29f71fcc134e71ac6d471453d847e2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:01.263873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.265346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.271532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 94/187] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/role_assignments?user.id=7f29f71fcc134e71ac6d471453d847e2&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:01.272313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.284436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:01.330861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60557b96-df66-4195-b374-f963e95661e1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.374392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.375057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.375403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.381489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.383178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.384816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.392206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 94/188] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:01.397674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.401109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f4e64-95cb-4fdb-a852-3602cca4ae4d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.428985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:01.452063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.452528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.452842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.453116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] PATH_INFO: `/v3/users/a43809f5fa65400d841fe4ad027df60b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.468416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] RBAC: Authorizing `identity:get_user(user_id=a43809f5fa65400d841fe4ad027df60b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.470076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.471699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 95/189] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/users/a43809f5fa65400d841fe4ad027df60b => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:01.477262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.522750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30bf68-6041-45b0-a658-03878828000a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.556655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:01.562119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.562765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.563055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.563329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] PATH_INFO: `/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.564692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] RBAC: Authorizing `identity:get_project(project_id=28819bafb0ef45f3ae7a7a6d469ac05a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.566412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.568111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 95/190] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/projects/28819bafb0ef45f3ae7a7a6d469ac05a => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:01.569483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.605090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef25a-f2a8-4fa1-a88f-c38499efb755 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.640023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.640548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.640802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.641075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.641798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:01.642166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.643577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.656699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 96/191] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:01.656699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.672004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:01.679254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed2cd-0fa1-44e1-b881-103d19b7f0fc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.714828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.715463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.715748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.716022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.716790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.718318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.741013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 96/192] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:01 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:01.742748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.782095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6630cb4-8b81-4665-b64f-ef6e7b33352e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.818840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:01.832488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21a41-c151-4ca0-b176-e289ab6215e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.833600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21a41-c151-4ca0-b176-e289ab6215e3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.834091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21a41-c151-4ca0-b176-e289ab6215e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.834680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21a41-c151-4ca0-b176-e289ab6215e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.886338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2163-a97a-46f7-843e-d2ab04af3c9d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:01.919395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21a41-c151-4ca0-b176-e289ab6215e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.920950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21a41-c151-4ca0-b176-e289ab6215e3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.926763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:01.927384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:01.927659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:01.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:01.928648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=28819bafb0ef45f3ae7a7a6d469ac05a, user.id=09756cf486814b05b937a688887b6c26) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:01.928954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:01.930644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:01.937250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 97/193] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/role_assignments?user.id=09756cf486814b05b937a688887b6c26&scope.project.id=28819bafb0ef45f3ae7a7a6d469ac05a&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:01.938170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:01.956189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:02.049573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 97/194] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:02.049573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599920-c907-4e6b-bbdf-076d56a65779 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.049573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599920-c907-4e6b-bbdf-076d56a65779 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.049573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b599920-c907-4e6b-bbdf-076d56a65779 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.051609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 98/195] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:02.054480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599920-c907-4e6b-bbdf-076d56a65779 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.080498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e358fc2-bbd3-43eb-8479-15d433991274 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:02.094839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:02.124407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003e2a1-a71c-4713-a63f-d29e2c8345b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:02.125332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e2a1-a71c-4713-a63f-d29e2c8345b2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.125796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e2a1-a71c-4713-a63f-d29e2c8345b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.126226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e2a1-a71c-4713-a63f-d29e2c8345b2 None admin] PATH_INFO: `/v3/users/a43809f5fa65400d841fe4ad027df60b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.127673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003e2a1-a71c-4713-a63f-d29e2c8345b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a43809f5fa65400d841fe4ad027df60b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:02.129720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003e2a1-a71c-4713-a63f-d29e2c8345b2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:02.131662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 98/196] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:01 2022] GET /identity/v3/users/a43809f5fa65400d841fe4ad027df60b => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:02.133492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fcb3-a247-4285-aaa4-81b26ac2c28c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.133492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fcb3-a247-4285-aaa4-81b26ac2c28c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.133492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050fcb3-a247-4285-aaa4-81b26ac2c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.153935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c050fcb3-a247-4285-aaa4-81b26ac2c28c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:02.155345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c050fcb3-a247-4285-aaa4-81b26ac2c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:02.182527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b599920-c907-4e6b-bbdf-076d56a65779 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:02.231737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:02.232447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.232727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.232999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.234176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:02.235637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:02.237306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 99/197] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:02.239827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 99/198] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:02.240035 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.249867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050fcb3-a247-4285-aaa4-81b26ac2c28c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.271071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:02.356454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe3a62-88ae-4f2f-809f-0bedd18948c1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:02.378307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050fcb3-a247-4285-aaa4-81b26ac2c28c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:02.378929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:02.399028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:02.399860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.400044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.400387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.432714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:02.433954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.434386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.434795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.435733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=a43809f5fa65400d841fe4ad027df60b) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:02.439520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:02.441152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:02.451891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 100/199] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/role_assignments?user.id=a43809f5fa65400d841fe4ad027df60b&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:02.497869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:02.499720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:02.541141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.621959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:02.627062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 100/200] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:02.635615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.640629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:02.686618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b472f-1ddb-44c4-a6df-25ed29b13cc3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:02.749420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:02.750460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.750977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.751475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.763904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:02.770385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:02.771324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:02.772138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:02.774790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 101/201] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:02.780415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114776a-0807-43f3-bea2-922aab555413 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:02.780785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.846287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:02.846943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.847218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.847486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.848990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:02.850283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:02.852277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 101/202] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:02.858155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.903943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da20b0-ec75-4121-b1a9-1f23880daa36 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:02.944088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:02.945104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:02.945631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:02.946116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:02.947942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:02.948456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:02.950134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:02.953117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:02.963201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 102/203] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:02.970820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:02.995020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:03.037057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06503-f10a-4b10-bf3a-c860dac458ae None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:03.072923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:03.073534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:03.073836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:03.074102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:03.074831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] RBAC: Adding query filter params (role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=a43809f5fa65400d841fe4ad027df60b) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:03.075132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:03.076629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:03.082680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 102/204] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/role_assignments?user.id=a43809f5fa65400d841fe4ad027df60b&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:03.160687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603308c-1600-4563-90ab-b68dd888c038 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:03.210895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:03.211524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:03.211804 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:03.212072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] PATH_INFO: `/v3/users/54ff5da3962448b8a679687c89a72b50` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:03.213456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] RBAC: Authorizing `identity:get_user(user_id=54ff5da3962448b8a679687c89a72b50)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:03.214988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:03.217073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 103/205] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:02 2022] GET /identity/v3/users/54ff5da3962448b8a679687c89a72b50 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:03.222872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:03.358352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f3530-6243-4be0-8df6-9a02457f08c5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:03.418244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:03.434241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:03.435232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:03.435739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:03.436211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:03.532038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:03.534121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:03.652242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 103/206] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:03.658136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:03.755655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:03.812676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136a03a-8f6e-449e-b82b-3842a6d82e95 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:03.870898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9304779-203a-4d03-9352-f6026de802f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:03.871561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9304779-203a-4d03-9352-f6026de802f2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:03.871842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9304779-203a-4d03-9352-f6026de802f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:03.872116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9304779-203a-4d03-9352-f6026de802f2 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:03.873334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9304779-203a-4d03-9352-f6026de802f2 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:03.874840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9304779-203a-4d03-9352-f6026de802f2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:03.876510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 104/207] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:03 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:03.883504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:03.925580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:04.017459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2907764-3564-41cf-a054-e545fc2cf6ed None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:04.053830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3303c-9bde-4048-8de0-b00f8faac876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:04.054445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3303c-9bde-4048-8de0-b00f8faac876 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:04.054726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3303c-9bde-4048-8de0-b00f8faac876 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:04.055000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3303c-9bde-4048-8de0-b00f8faac876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:04.055741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3303c-9bde-4048-8de0-b00f8faac876 None admin] RBAC: Adding query filter params (role.id=fa61aa1209a54a50b96d3280153e0485, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377, user.id=54ff5da3962448b8a679687c89a72b50) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:04.056047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3303c-9bde-4048-8de0-b00f8faac876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:04.057526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3303c-9bde-4048-8de0-b00f8faac876 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:04.064056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 104/208] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:03 2022] GET /identity/v3/role_assignments?user.id=54ff5da3962448b8a679687c89a72b50&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=fa61aa1209a54a50b96d3280153e0485 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:04.295277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57e3bc-9e97-4713-a738-feb40fc742be None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:04.295673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57e3bc-9e97-4713-a738-feb40fc742be None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:04.295844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57e3bc-9e97-4713-a738-feb40fc742be None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:04.297401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 105/209] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:04.302908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff11d1-462f-4145-a6c6-57a446008928 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:04.303198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff11d1-462f-4145-a6c6-57a446008928 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:04.303477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff11d1-462f-4145-a6c6-57a446008928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:04.328391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dfff11d1-462f-4145-a6c6-57a446008928 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:04.329519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dfff11d1-462f-4145-a6c6-57a446008928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:04.407007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 105/210] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:04.610810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d087-f527-4762-aad6-dcf17f8bc920 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:04.610993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d087-f527-4762-aad6-dcf17f8bc920 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:04.611269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d087-f527-4762-aad6-dcf17f8bc920 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:04.612790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 106/211] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:04.618205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9966-9536-4d90-97ab-31f27a98e6c5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:04.618494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9966-9536-4d90-97ab-31f27a98e6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:04.618769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9966-9536-4d90-97ab-31f27a98e6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:04.645458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ae8c9966-9536-4d90-97ab-31f27a98e6c5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:04.646679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ae8c9966-9536-4d90-97ab-31f27a98e6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:04.666043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:04.724214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d087-f527-4762-aad6-dcf17f8bc920 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:04.727524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 106/212] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:04.832735 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d087-f527-4762-aad6-dcf17f8bc920 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:04.868066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:04.868623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:04.868906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:04.869220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:04.871173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:04.881386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:04.886423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:04.887271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:04.888306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 107/213] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:04.893391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c9966-9536-4d90-97ab-31f27a98e6c5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:04.998050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c9966-9536-4d90-97ab-31f27a98e6c5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:04.999823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.033856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87854a-a6a8-4420-b8f7-8832e6cb780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.034468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87854a-a6a8-4420-b8f7-8832e6cb780c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.034744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87854a-a6a8-4420-b8f7-8832e6cb780c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.035013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87854a-a6a8-4420-b8f7-8832e6cb780c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.035671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87854a-a6a8-4420-b8f7-8832e6cb780c None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:05.035973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87854a-a6a8-4420-b8f7-8832e6cb780c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:05.037360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87854a-a6a8-4420-b8f7-8832e6cb780c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:05.045810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 107/214] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:05.047131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e98cd-9cb7-40e8-97e6-5e60e8566df7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.047414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e98cd-9cb7-40e8-97e6-5e60e8566df7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.047682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e98cd-9cb7-40e8-97e6-5e60e8566df7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.049096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 108/215] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:05.055009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e98cd-9cb7-40e8-97e6-5e60e8566df7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.069219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:05.122850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074bd63-e73c-487b-8dfa-38a8f64075e4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:05.156154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e98cd-9cb7-40e8-97e6-5e60e8566df7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:05.160514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb919cd-4e57-45cc-be3d-6f5b4949f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.161386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb919cd-4e57-45cc-be3d-6f5b4949f755 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.161952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb919cd-4e57-45cc-be3d-6f5b4949f755 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.162416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb919cd-4e57-45cc-be3d-6f5b4949f755 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.163923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb919cd-4e57-45cc-be3d-6f5b4949f755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:05.165648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb919cd-4e57-45cc-be3d-6f5b4949f755 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:05.167415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 108/216] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:05.168602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e338a73-00f5-4b00-a148-95213c700e65 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.168880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e338a73-00f5-4b00-a148-95213c700e65 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.169150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e338a73-00f5-4b00-a148-95213c700e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.190131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3e338a73-00f5-4b00-a148-95213c700e65 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:05.191321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3e338a73-00f5-4b00-a148-95213c700e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:05.197502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.198349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.198877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.199300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] PATH_INFO: `/v3/users/675557e092194ff0ba2b4e08464cc4f2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.213838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] RBAC: Authorizing `identity:get_user(user_id=675557e092194ff0ba2b4e08464cc4f2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:05.215305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:05.221593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 109/217] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:05 2022] GET /identity/v3/users/675557e092194ff0ba2b4e08464cc4f2 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:05.221593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.254970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:05.269595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 109/218] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:05.274633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e338a73-00f5-4b00-a148-95213c700e65 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.306526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:05.340804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5df742-032d-42e4-9b50-d3e81e5063e9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:05.377254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a412a6f-2ea2-465b-a228-922bd4fcf7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.378230 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412a6f-2ea2-465b-a228-922bd4fcf7b3 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.378718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412a6f-2ea2-465b-a228-922bd4fcf7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.379515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412a6f-2ea2-465b-a228-922bd4fcf7b3 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.380166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a412a6f-2ea2-465b-a228-922bd4fcf7b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:05.381630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a412a6f-2ea2-465b-a228-922bd4fcf7b3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:05.395544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e338a73-00f5-4b00-a148-95213c700e65 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:05.413207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 110/219] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:05 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:05.415135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77a06-0cb8-4161-b710-b1d5f608ef84 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.415491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77a06-0cb8-4161-b710-b1d5f608ef84 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.415842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77a06-0cb8-4161-b710-b1d5f608ef84 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.417368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 111/220] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:05.423362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a7f3-bae4-4bd5-b296-f32f8a394bdc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.423706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a7f3-bae4-4bd5-b296-f32f8a394bdc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.424050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3a7f3-bae4-4bd5-b296-f32f8a394bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.445978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-79a3a7f3-bae4-4bd5-b296-f32f8a394bdc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:05.447542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-79a3a7f3-bae4-4bd5-b296-f32f8a394bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:05.448068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.448965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.449451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.450125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.522333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:05.535392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 112/221] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:05.535876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:05.536461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3a7f3-bae4-4bd5-b296-f32f8a394bdc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.538304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:05.615167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:05.665796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 110/222] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:05.672540 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.680832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3a7f3-bae4-4bd5-b296-f32f8a394bdc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:05.729572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.731646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.731646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.731646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.744886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:05.749882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:05.750755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:05.751718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 113/223] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:05.757196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.801034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:05.812361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6fc20-ccac-4116-abc4-614f2cc9488e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:05.850036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.850674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.850942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.851205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.852378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:05.854057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:05.855877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 111/224] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:05 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:05.856812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.893027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a739e8-5e48-4501-b84c-110be3a2d07f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:05.910567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:05.934390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:05.934937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:05.935218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:05.935513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:05.936217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:05.936521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:05.937994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:05.951435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 114/225] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:05.952311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:05.989288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007461-bf1c-43a7-9a40-4d3937e3e902 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.043395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.044050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.044565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.044914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.059918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:06.064769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff8a5-7634-4dbc-a8cb-10611af164ef None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:06.066005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:06.066855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:06.067629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 112/226] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:06.068256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:06.098783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:06.106513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.107507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.107979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.108440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.109371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=675557e092194ff0ba2b4e08464cc4f2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:06.109900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.111629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.118340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 115/227] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:05 2022] GET /identity/v3/role_assignments?user.id=675557e092194ff0ba2b4e08464cc4f2&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:06.119477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:06.194410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:06.244342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378a060-a037-4557-bd96-4d8817406018 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.290011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5202fe-ee7a-49e6-b34d-3f91188ab5ff None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.302922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.303817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.304187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.304539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] PATH_INFO: `/v3/users/a43809f5fa65400d841fe4ad027df60b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.305806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] RBAC: Authorizing `identity:get_user(user_id=a43809f5fa65400d841fe4ad027df60b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.307499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.309215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 113/228] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:06 2022] GET /identity/v3/users/a43809f5fa65400d841fe4ad027df60b => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:06.315353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:06.326794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.327461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.327737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.328008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.328701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:06.329004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.330468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.339301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 116/229] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:06.345020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:06.450929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:06.473413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2264b-a224-494f-9ab8-1918ae5993d8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.535775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.536463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.536744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.537021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.538648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.541020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.543151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 114/230] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:06 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:06.543481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e38be-d55e-4aa1-ae76-d088c80b8cbb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.557580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:06.557751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:06.615073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.615758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.616040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.616309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] PATH_INFO: `/v3/users/a43809f5fa65400d841fe4ad027df60b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.618798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] RBAC: Authorizing `identity:get_user(user_id=a43809f5fa65400d841fe4ad027df60b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.620038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.621821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 117/231] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:06 2022] GET /identity/v3/users/a43809f5fa65400d841fe4ad027df60b => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:06.627689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:06.743557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffda6c6-9f02-443b-9735-42cacf0b0309 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.747293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49745bd5-d883-46a8-8e0b-c571cc316350 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.783221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.783929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.784213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.784496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.785745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.787298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.789101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 118/232] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:06 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:06.795216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:06.808090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b35938-6265-4c14-a2a5-780997ecb611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.808850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35938-6265-4c14-a2a5-780997ecb611 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.809128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35938-6265-4c14-a2a5-780997ecb611 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.809397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b35938-6265-4c14-a2a5-780997ecb611 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/a43809f5fa65400d841fe4ad027df60b/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.815024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b35938-6265-4c14-a2a5-780997ecb611 None admin] RBAC: Authorizing `identity:create_grant(project_id=892d647615f4492b88dc72f4b3d3d17a, user_id=a43809f5fa65400d841fe4ad027df60b, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.816564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b35938-6265-4c14-a2a5-780997ecb611 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.840320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:06.841136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 115/233] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:06 2022] PUT /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/a43809f5fa65400d841fe4ad027df60b/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:06.926350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb5e9a-1632-4efe-ad30-a59bdfbc321c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:06.968162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ea077-cdd8-483e-b5dd-e83f6cc86328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:06.968857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea077-cdd8-483e-b5dd-e83f6cc86328 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:06.969138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea077-cdd8-483e-b5dd-e83f6cc86328 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:06.969420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea077-cdd8-483e-b5dd-e83f6cc86328 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/a43809f5fa65400d841fe4ad027df60b/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:06.971635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ea077-cdd8-483e-b5dd-e83f6cc86328 None admin] RBAC: Authorizing `identity:create_grant(project_id=892d647615f4492b88dc72f4b3d3d17a, user_id=a43809f5fa65400d841fe4ad027df60b, role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:06.973175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ea077-cdd8-483e-b5dd-e83f6cc86328 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:06.990032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 119/234] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:06 2022] PUT /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/a43809f5fa65400d841fe4ad027df60b/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:07.889835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96c64-fa4f-464b-9f04-84c102aebe6b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:07.890380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96c64-fa4f-464b-9f04-84c102aebe6b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:07.890380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96c64-fa4f-464b-9f04-84c102aebe6b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:07.891717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 116/235] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:07.897982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60100-4980-485f-b14b-499be5f5043b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:07.898442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60100-4980-485f-b14b-499be5f5043b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:07.898522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60100-4980-485f-b14b-499be5f5043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:07.926520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d8d60100-4980-485f-b14b-499be5f5043b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:07.927722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d8d60100-4980-485f-b14b-499be5f5043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:08.013522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 120/236] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:08.096470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10042-7f89-49ed-a9b6-e25e7088a4ea None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10042-7f89-49ed-a9b6-e25e7088a4ea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.097013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10042-7f89-49ed-a9b6-e25e7088a4ea None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.098565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 117/237] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:08.103873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b99a-f900-4175-af67-3d0f8c1ba4a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.104179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b99a-f900-4175-af67-3d0f8c1ba4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.104445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b99a-f900-4175-af67-3d0f8c1ba4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.123052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0825b99a-f900-4175-af67-3d0f8c1ba4a3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:08.124226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0825b99a-f900-4175-af67-3d0f8c1ba4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:08.165314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:08.219572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:08.337966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10042-7f89-49ed-a9b6-e25e7088a4ea None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:08.361979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:08.433383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b18ab-fa93-4b70-b866-9dc40315f3f6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.434043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b18ab-fa93-4b70-b866-9dc40315f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.434517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b18ab-fa93-4b70-b866-9dc40315f3f6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.436397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 122/239] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:08.441400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582fed-6297-4d2c-ab21-44197c79668d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.441794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582fed-6297-4d2c-ab21-44197c79668d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.442078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582fed-6297-4d2c-ab21-44197c79668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.466442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10042-7f89-49ed-a9b6-e25e7088a4ea None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:08.479937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-44582fed-6297-4d2c-ab21-44197c79668d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:08.481479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-44582fed-6297-4d2c-ab21-44197c79668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:08.507719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:08.508360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.508630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.508888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.528728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:08.535023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:08.535886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:08.536662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 118/240] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:08.541819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:08.593986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 123/241] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:08.595223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582fed-6297-4d2c-ab21-44197c79668d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:08.640175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:08.665059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ae150-a240-475e-9e51-ee7655604644 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:08.702182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:08.702922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.703257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.703588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.705106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:08.706682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:08.708581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 119/242] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:08.714484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:08.719898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:08.736213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582fed-6297-4d2c-ab21-44197c79668d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:08.799527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:08.800164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.800436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.800703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.801375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:08.801699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:08.806931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:08.823345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 124/243] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:08.832750 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:08.876931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb6f10-dcea-48cd-8f71-c1cff8880869 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:08.915118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:08.915764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.915990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.916283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.917039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:08.918583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:08.940194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:08.946012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 120/244] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:08 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:08.991508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a98cb-d7db-4272-8208-05ff662b4d9a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:09.018711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:09.032396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:09.033139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.033415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.033713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] PATH_INFO: `/v3/users/e63b248c17fa482dbad204c823a32929` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.049016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] RBAC: Authorizing `identity:get_user(user_id=e63b248c17fa482dbad204c823a32929)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:09.050522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:09.052225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 125/245] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:08 2022] GET /identity/v3/users/e63b248c17fa482dbad204c823a32929 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:09.067652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:09.090384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:09.192326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493f9b-40b7-4039-80d2-b9b5d117938f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:09.226869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90280-77b0-4868-b12d-d7582b6eea54 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:09.240581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60209e8e-3978-46ea-928b-3cd70df95813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:09.241598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60209e8e-3978-46ea-928b-3cd70df95813 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.242343 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60209e8e-3978-46ea-928b-3cd70df95813 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.242655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60209e8e-3978-46ea-928b-3cd70df95813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.272545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:09.273259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.273552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.273848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.290978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:09.297116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:09.298045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:09.298911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 121/246] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:09.305791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:09.329180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60209e8e-3978-46ea-928b-3cd70df95813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:09.331552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60209e8e-3978-46ea-928b-3cd70df95813 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:09.347377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:09.396711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:09.453217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 126/247] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:23:09.455161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dab65-4fe9-41d0-9682-624cbd129cbe None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:09.458731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb557617-dfe0-4d15-a8a0-262e28dcf587 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.459022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb557617-dfe0-4d15-a8a0-262e28dcf587 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.459304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb557617-dfe0-4d15-a8a0-262e28dcf587 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.460874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 127/248] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:09.463327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb557617-dfe0-4d15-a8a0-262e28dcf587 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:09.502947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71fb3f-0bc6-4eb0-9156-46e668b18f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:09.504836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71fb3f-0bc6-4eb0-9156-46e668b18f75 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.504836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71fb3f-0bc6-4eb0-9156-46e668b18f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.504836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71fb3f-0bc6-4eb0-9156-46e668b18f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.505190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71fb3f-0bc6-4eb0-9156-46e668b18f75 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:09.505580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71fb3f-0bc6-4eb0-9156-46e668b18f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:09.507926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71fb3f-0bc6-4eb0-9156-46e668b18f75 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:09.520430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 122/249] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:09.521861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a9f1-b1f4-4208-86e1-f229f5bde94b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.522121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a9f1-b1f4-4208-86e1-f229f5bde94b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.522414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a9f1-b1f4-4208-86e1-f229f5bde94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.543106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6246a9f1-b1f4-4208-86e1-f229f5bde94b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:09.544289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6246a9f1-b1f4-4208-86e1-f229f5bde94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:09.613130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb557617-dfe0-4d15-a8a0-262e28dcf587 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:09.625992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:09.643821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 123/250] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:09.645175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a9f1-b1f4-4208-86e1-f229f5bde94b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:09.653856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534a379-c4b9-4bf5-b7c2-002a7debfd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:09.654743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a379-c4b9-4bf5-b7c2-002a7debfd45 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.655080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a379-c4b9-4bf5-b7c2-002a7debfd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.655412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534a379-c4b9-4bf5-b7c2-002a7debfd45 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.656597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534a379-c4b9-4bf5-b7c2-002a7debfd45 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:09.658270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534a379-c4b9-4bf5-b7c2-002a7debfd45 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:09.660410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 128/251] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:09.662940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03375b-d50b-4096-bf06-2815d79e73c5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.663077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03375b-d50b-4096-bf06-2815d79e73c5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.663458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03375b-d50b-4096-bf06-2815d79e73c5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.664900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 129/252] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:09.669876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03375b-d50b-4096-bf06-2815d79e73c5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:09.709487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:09.799067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a9f1-b1f4-4208-86e1-f229f5bde94b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:09.820123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03375b-d50b-4096-bf06-2815d79e73c5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:09.865684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81279a6b-b5e0-4860-9a46-ab09d931183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:09.866377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279a6b-b5e0-4860-9a46-ab09d931183f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.866651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279a6b-b5e0-4860-9a46-ab09d931183f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.866915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279a6b-b5e0-4860-9a46-ab09d931183f None admin] PATH_INFO: `/v3/users/675557e092194ff0ba2b4e08464cc4f2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.868085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81279a6b-b5e0-4860-9a46-ab09d931183f None admin] RBAC: Authorizing `identity:get_user(user_id=675557e092194ff0ba2b4e08464cc4f2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:09.869679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81279a6b-b5e0-4860-9a46-ab09d931183f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:09.871582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 124/253] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/users/675557e092194ff0ba2b4e08464cc4f2 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:09.872567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca568-749d-4caa-9422-1e1cc54b43ab None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.872899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca568-749d-4caa-9422-1e1cc54b43ab None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.873165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca568-749d-4caa-9422-1e1cc54b43ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.892513 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-33cca568-749d-4caa-9422-1e1cc54b43ab None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:09.893774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-33cca568-749d-4caa-9422-1e1cc54b43ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:09.902486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:09.903114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:09.903395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:09.903668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:09.904509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] RBAC: Adding query filter params (role.id=fa61aa1209a54a50b96d3280153e0485, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=e63b248c17fa482dbad204c823a32929) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:09.904829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:09.914490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:09.921094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 130/254] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/role_assignments?user.id=e63b248c17fa482dbad204c823a32929&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=fa61aa1209a54a50b96d3280153e0485 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:09.922019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:09.970493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 125/255] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:09.971342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cca568-749d-4caa-9422-1e1cc54b43ab None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.002143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.090250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc12f0-206d-4a10-980f-f900489a5ee9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.090928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.150796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.151939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.152437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.152931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.158310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.160101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.162455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 131/256] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:10.167905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.173349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cca568-749d-4caa-9422-1e1cc54b43ab None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.209082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.209747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.210023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.210648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.233116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:10.240043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:10.240926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:10.241748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:10.242341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 126/257] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:10.256040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.370948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc72b-aa35-485d-9945-dbcb58100af8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.393777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.441579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.442260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.442536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.442801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/675557e092194ff0ba2b4e08464cc4f2/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.448527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991820-da97-40ce-9e52-3595eb177c19 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.451004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=892d647615f4492b88dc72f4b3d3d17a, user_id=675557e092194ff0ba2b4e08464cc4f2, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.452716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.460073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.475913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 132/258] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:10 2022] PUT /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/675557e092194ff0ba2b4e08464cc4f2/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:23:10.476846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.490248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.491360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.491824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.492290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.493179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:10.493690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.495593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.505618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 127/259] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:10.512140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.659280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3dba1-b3ce-419f-9cea-0af8feb73e82 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.725193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.726105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.726455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.726781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] PATH_INFO: `/v3/users/a43809f5fa65400d841fe4ad027df60b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.730493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] RBAC: Authorizing `identity:get_user(user_id=a43809f5fa65400d841fe4ad027df60b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.732325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.734648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 128/260] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:10 2022] GET /identity/v3/users/a43809f5fa65400d841fe4ad027df60b => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:10.735917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd7875-e3fb-471c-bc0c-eaf741107dbf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.740635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.796080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.826475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.826938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.827217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.827484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.843034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:10.848562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:10.849524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:10.850359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 133/261] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:10.856045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.865122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71829b26-6d84-4c61-881c-681def24c877 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.901416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.902475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.902953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.903464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.913853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.994357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.995989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.027501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077df1-5860-4b60-bcfc-1cd47f3e3a40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.045779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:11.081014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.081651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.081928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.082195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.082860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:11.083163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.084538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.101747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 129/262] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:11.102140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 134/263] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:11.107768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.107931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.216156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b620f2-b29b-43f1-b6f6-3f86d347189d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.254952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.255801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.256197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.256583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.257899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.259575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.261683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 130/264] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:11.267624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:11.269245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.283801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:11.287057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3dcd6-85ef-4b56-89ab-665ec15b1300 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.355221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.356190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.356606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.357072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] PATH_INFO: `/v3/users/a43809f5fa65400d841fe4ad027df60b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.360716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] RBAC: Authorizing `identity:get_user(user_id=a43809f5fa65400d841fe4ad027df60b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.362477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.365351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 135/265] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/users/a43809f5fa65400d841fe4ad027df60b => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:11.369898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.381180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba541-2cd2-44b1-850b-44dea397771b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.423158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.423938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.424314 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.424592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.425434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] RBAC: Adding query filter params (role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=a43809f5fa65400d841fe4ad027df60b) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:11.425785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.427486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.442931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 131/266] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/role_assignments?user.id=a43809f5fa65400d841fe4ad027df60b&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:11.512653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8e0a7-b7f9-468c-9159-d6fc285738cf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.551312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea97216-dc01-41ba-83b2-e8f83457768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.552366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97216-dc01-41ba-83b2-e8f83457768b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.552819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97216-dc01-41ba-83b2-e8f83457768b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.553283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea97216-dc01-41ba-83b2-e8f83457768b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.592504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:11.649696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea97216-dc01-41ba-83b2-e8f83457768b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.651201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea97216-dc01-41ba-83b2-e8f83457768b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.795768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 136/267] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:23:11.802591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.920967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:11.958209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec8a3-cf02-4211-8ecb-753b9bc4fe84 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.996447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce895c03-0945-499e-8ac5-124bc12d47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.997078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895c03-0945-499e-8ac5-124bc12d47b3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.997352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895c03-0945-499e-8ac5-124bc12d47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.997667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895c03-0945-499e-8ac5-124bc12d47b3 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.998838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce895c03-0945-499e-8ac5-124bc12d47b3 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.999164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25adb5-b1f7-4b78-b3ea-9f948fa3ba01 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.999461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25adb5-b1f7-4b78-b3ea-9f948fa3ba01 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.999737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25adb5-b1f7-4b78-b3ea-9f948fa3ba01 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.000289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce895c03-0945-499e-8ac5-124bc12d47b3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:12.001276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 137/268] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:12.002212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 132/269] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:12.008005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25adb5-b1f7-4b78-b3ea-9f948fa3ba01 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:12.011348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c452-7e2d-4b87-a627-407cc897ef72 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:12.011627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c452-7e2d-4b87-a627-407cc897ef72 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:12.011893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c452-7e2d-4b87-a627-407cc897ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.034634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9486c452-7e2d-4b87-a627-407cc897ef72 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:12.035833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9486c452-7e2d-4b87-a627-407cc897ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:12.145843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:12.148595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 133/270] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:12.218253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25adb5-b1f7-4b78-b3ea-9f948fa3ba01 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:12.258688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270ff39-bd27-41cb-b8fb-6b5be0d23d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:12.259602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ff39-bd27-41cb-b8fb-6b5be0d23d5b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:12.260014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ff39-bd27-41cb-b8fb-6b5be0d23d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:12.260414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ff39-bd27-41cb-b8fb-6b5be0d23d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.261345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270ff39-bd27-41cb-b8fb-6b5be0d23d5b None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=a43809f5fa65400d841fe4ad027df60b) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:12.261878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270ff39-bd27-41cb-b8fb-6b5be0d23d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:12.263511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270ff39-bd27-41cb-b8fb-6b5be0d23d5b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:12.270404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 138/271] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:12 2022] GET /identity/v3/role_assignments?user.id=a43809f5fa65400d841fe4ad027df60b&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:12.292025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1deb94-5bcb-4cb6-9ae6-f9fa0544c436 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:12.292665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1deb94-5bcb-4cb6-9ae6-f9fa0544c436 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:12.293083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1deb94-5bcb-4cb6-9ae6-f9fa0544c436 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.294895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 134/272] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:12.301106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b523-b40e-4840-ba6b-9118e34f6568 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:12.301671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b523-b40e-4840-ba6b-9118e34f6568 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:12.302121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b523-b40e-4840-ba6b-9118e34f6568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.330778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9578b523-b40e-4840-ba6b-9118e34f6568 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:12.332296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9578b523-b40e-4840-ba6b-9118e34f6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:12.424416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 139/273] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:12.543865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1deb94-5bcb-4cb6-9ae6-f9fa0544c436 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:12.623639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:12.667961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1deb94-5bcb-4cb6-9ae6-f9fa0544c436 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:12.721320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:12.722079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:12.722351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:12.722619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.736104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:12.741312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:12.742223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:12.743008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 135/274] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:12.743677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b523-b40e-4840-ba6b-9118e34f6568 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:12.750845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:12.813916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:12.861943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578b523-b40e-4840-ba6b-9118e34f6568 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:12.876020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9726c8c-a790-48e1-bb29-0fa4ea5dda47 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:12.899962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:12.900604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:12.900925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:12.901260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.902361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:12.903825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:12.905775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 140/275] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:12.911173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:12.917960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:12.918573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:12.918843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:12.919106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:12.919797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:12.920090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:12.922006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:12.933886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:12.937638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 136/276] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:12.939563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:13.026464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833b9d5-541b-42ca-9fad-cb4708049225 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:13.056925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:13.060792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe554bc-e28e-4836-bdff-b76b11893591 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:13.073811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5ba90-2b6a-448e-b61a-3585ff5db651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:13.074560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ba90-2b6a-448e-b61a-3585ff5db651 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.074901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ba90-2b6a-448e-b61a-3585ff5db651 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.075180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5ba90-2b6a-448e-b61a-3585ff5db651 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.075883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5ba90-2b6a-448e-b61a-3585ff5db651 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:13.077463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5ba90-2b6a-448e-b61a-3585ff5db651 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:13.098322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:13.098998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.099287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.099578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] PATH_INFO: `/v3/users/1699243368bd4bb79acefe190615bf07` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.104173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 141/277] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:12 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:23:13.105720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83766-0be6-40ee-a5d1-2f279c02e3db None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.106285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83766-0be6-40ee-a5d1-2f279c02e3db None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.106794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83766-0be6-40ee-a5d1-2f279c02e3db None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.109018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 142/278] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:13.115524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1302fc-765a-4e74-ad28-d6b1633be123 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.116501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1302fc-765a-4e74-ad28-d6b1633be123 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.117070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1302fc-765a-4e74-ad28-d6b1633be123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.118979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] RBAC: Authorizing `identity:get_user(user_id=1699243368bd4bb79acefe190615bf07)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:13.120659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:13.128010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 137/279] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:12 2022] GET /identity/v3/users/1699243368bd4bb79acefe190615bf07 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:13.129438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:13.142971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6a1302fc-765a-4e74-ad28-d6b1633be123 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:13.145204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a1302fc-765a-4e74-ad28-d6b1633be123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:13.191414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:13.229844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 143/280] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:13.235571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c37fb-cdc1-4374-b803-39878782c371 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.236061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c37fb-cdc1-4374-b803-39878782c371 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.236452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c37fb-cdc1-4374-b803-39878782c371 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.242946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 144/281] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:13.245814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47334e3-b6c4-4f25-a98f-55c1acebbb65 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.246097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47334e3-b6c4-4f25-a98f-55c1acebbb65 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.246360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47334e3-b6c4-4f25-a98f-55c1acebbb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.257671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48938dc-cac2-4cd5-a569-2dacea2465d6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:13.272000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f47334e3-b6c4-4f25-a98f-55c1acebbb65 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:13.274547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f47334e3-b6c4-4f25-a98f-55c1acebbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:13.299244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:13.299792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.300131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.300329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.301072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, user.id=1699243368bd4bb79acefe190615bf07, scope.system=all) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:13.301373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:13.304142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:13.309537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 138/282] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 30 00:23:13 2022] GET /identity/v3/role_assignments?user.id=1699243368bd4bb79acefe190615bf07&scope.system=all&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:13.356766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 145/283] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:13.504288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:13.619113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fefc6-6a67-44dd-9552-9bcdecc7576c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:13.629926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47334e3-b6c4-4f25-a98f-55c1acebbb65 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:13.636322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:13.664265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:13.665081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.665414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.665706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.688363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:13.693481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:13.694356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:13.695129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 139/284] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:13.705815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:13.721940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:13.849110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9884e-6c1b-4cb3-83b6-44fc92bca28a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:13.859709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47334e3-b6c4-4f25-a98f-55c1acebbb65 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:13.887465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:13.887993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.888269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.888611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.889582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:13.889582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:13.893577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:13.899982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 140/285] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:13.906106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:13.925740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:13.926766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:13.927325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:13.927811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:13.939123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:13.944576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:13.945432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:13.946257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:13.948787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 146/286] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:13.949848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:13.954844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:14.019778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464001b5-3dbc-4d1d-b328-8c29cbfb3f3f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:14.075016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa015f-c9e0-4a46-90b1-d5eeba1718df None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:14.094514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:14.115030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:14.116090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:14.117877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:14.118889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:14.120126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:14.121187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:14.123345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:14.126829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:14.128057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:14.129962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:14.130453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] PATH_INFO: `/v3/users/e63b248c17fa482dbad204c823a32929` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:14.135198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] RBAC: Authorizing `identity:get_user(user_id=e63b248c17fa482dbad204c823a32929)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:14.136917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:14.139022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 141/287] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:13 2022] GET /identity/v3/users/e63b248c17fa482dbad204c823a32929 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:14.142689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 147/288] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:14.144414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:14.149945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:14.270855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54714f58-b76b-4180-bb51-86848327ad2f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:14.338150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:14.339393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:14.340945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:14.341444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] PATH_INFO: `/v3/users/675557e092194ff0ba2b4e08464cc4f2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:14.343705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] RBAC: Authorizing `identity:get_user(user_id=675557e092194ff0ba2b4e08464cc4f2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:14.345678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:14.348177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 148/289] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:14 2022] GET /identity/v3/users/675557e092194ff0ba2b4e08464cc4f2 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:14.353873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:14.366961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ca082-20b3-48eb-80ac-eaff535ae2cf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:14.371883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:14.425941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:14.442303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:14.443283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:14.443758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:14.444223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:14.447384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:14.449056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:14.455243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 142/290] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:14 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:14.459283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:14.559562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c8ee-a521-4ab6-b810-45ddd5b1773b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:14.596944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:14.597953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:14.598432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:14.598916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:14.648884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933caf4-8133-492e-9a30-cf02306d4be4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:14.674452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:14.676264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:14.698365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:14.699062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:14.699443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:14.699788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/e63b248c17fa482dbad204c823a32929/roles/fa61aa1209a54a50b96d3280153e0485` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:14.703922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] RBAC: Authorizing `identity:create_grant(project_id=892d647615f4492b88dc72f4b3d3d17a, user_id=e63b248c17fa482dbad204c823a32929, role_id=fa61aa1209a54a50b96d3280153e0485)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:14.705818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:14.725708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:14.735420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 143/291] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:14 2022] PUT /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a/users/e63b248c17fa482dbad204c823a32929/roles/fa61aa1209a54a50b96d3280153e0485 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:14.790952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 149/292] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:14.797271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:14.844665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:14.941857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2e901-4c8d-494f-9d8c-043e56079a9f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:14.980008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701debf-7737-4fa9-b7b1-1e9094a11e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:14.980656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701debf-7737-4fa9-b7b1-1e9094a11e9f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:14.980933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701debf-7737-4fa9-b7b1-1e9094a11e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:14.981207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701debf-7737-4fa9-b7b1-1e9094a11e9f None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:14.982468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701debf-7737-4fa9-b7b1-1e9094a11e9f None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:14.983942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701debf-7737-4fa9-b7b1-1e9094a11e9f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:14.987557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 144/293] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:14 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:14.998880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:15.135637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298011f9-acb2-494f-a7e5-3d9665dae9f8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:15.164068 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:15.172497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5569d-b488-4e6d-a771-9c05089559d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:15.173399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5569d-b488-4e6d-a771-9c05089559d5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:15.173947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5569d-b488-4e6d-a771-9c05089559d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:15.174413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5569d-b488-4e6d-a771-9c05089559d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:15.175398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5569d-b488-4e6d-a771-9c05089559d5 None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=675557e092194ff0ba2b4e08464cc4f2) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:15.175902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5569d-b488-4e6d-a771-9c05089559d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:15.177531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5569d-b488-4e6d-a771-9c05089559d5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:15.183993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 150/294] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:14 2022] GET /identity/v3/role_assignments?user.id=675557e092194ff0ba2b4e08464cc4f2&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:15.460003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c65ab-18fc-4f00-a2f7-7125f4b59668 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:15.460533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c65ab-18fc-4f00-a2f7-7125f4b59668 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:15.460776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c65ab-18fc-4f00-a2f7-7125f4b59668 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:15.462340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 145/295] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:15.467518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa491b-6751-448b-a844-737100dde55c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:15.468009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa491b-6751-448b-a844-737100dde55c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:15.468100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa491b-6751-448b-a844-737100dde55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:15.490640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cbaa491b-6751-448b-a844-737100dde55c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:15.491854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cbaa491b-6751-448b-a844-737100dde55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:15.517755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7070c-f71e-42bf-9058-39bc7a3845c5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:15.518056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7070c-f71e-42bf-9058-39bc7a3845c5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:15.518289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7070c-f71e-42bf-9058-39bc7a3845c5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:15.519630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 146/296] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:15.524830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76544af3-4b58-43b7-bb51-68de39cfe552 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:15.525108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76544af3-4b58-43b7-bb51-68de39cfe552 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:15.525446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76544af3-4b58-43b7-bb51-68de39cfe552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:15.547152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-76544af3-4b58-43b7-bb51-68de39cfe552 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:15.548375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-76544af3-4b58-43b7-bb51-68de39cfe552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:15.590456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 151/297] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:15.642695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 147/298] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:15.835267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997f579-dd09-453f-aaa5-ddb07890c612 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:15.835569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997f579-dd09-453f-aaa5-ddb07890c612 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:15.836030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997f579-dd09-453f-aaa5-ddb07890c612 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:15.837521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 152/299] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:15.842989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b584-67f3-42b3-bc56-b17d2e1166ee None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:15.843392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b584-67f3-42b3-bc56-b17d2e1166ee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:15.843755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b584-67f3-42b3-bc56-b17d2e1166ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:15.862752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-12f8b584-67f3-42b3-bc56-b17d2e1166ee None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:15.863979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-12f8b584-67f3-42b3-bc56-b17d2e1166ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:15.869187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997f579-dd09-453f-aaa5-ddb07890c612 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:15.890671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:15.945471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 148/300] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:15.946222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8b584-67f3-42b3-bc56-b17d2e1166ee None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:15.982443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997f579-dd09-453f-aaa5-ddb07890c612 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.007612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:16.021254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.021979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.022257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.022526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.037171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:16.043233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:16.044117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:16.050540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 153/301] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:16.054725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.078474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8b584-67f3-42b3-bc56-b17d2e1166ee None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.114621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.115260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.115537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.115861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.126774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:16.131970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:16.133498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:16.135144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:16.138168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 149/302] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:16.140467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.164043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:16.179188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ae4fc-cd3b-4edd-a6a9-277f8638ade1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.216560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.217634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.218136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.218617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.219495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:16.219989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.221585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.230475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 154/303] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:16.235961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.248112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a4128-f85a-4d5d-8657-a609db6564aa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.283043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:16.284414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.285048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.285338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.285718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.286454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:16.286792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.288238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.297807 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 150/304] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:16.298474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.352139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36581e37-1abe-49b7-8f08-6be0efb9a045 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.383589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:16.392927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.393616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.393898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.394170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.395329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.396810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.398452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 155/305] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:16.401721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.409315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28b06-68f5-4d0d-aa86-e1522732980a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.445379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.446101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.446380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.446652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] PATH_INFO: `/v3/users/4522705e15cc4d09940708fef37c43b6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.460633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] RBAC: Authorizing `identity:get_user(user_id=4522705e15cc4d09940708fef37c43b6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.462211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.469098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 151/306] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:16 2022] GET /identity/v3/users/4522705e15cc4d09940708fef37c43b6 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:16.469881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.507592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60d2f-6f96-48fd-836e-2bc0db7f44b3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.521643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:16.544966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.545649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.545934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.546211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] PATH_INFO: `/v3/users/1699243368bd4bb79acefe190615bf07` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.547356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] RBAC: Authorizing `identity:get_user(user_id=1699243368bd4bb79acefe190615bf07)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.548905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.555653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 156/307] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:16 2022] GET /identity/v3/users/1699243368bd4bb79acefe190615bf07 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:16.555653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.583849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e52d5d-9bfa-427d-b43b-1642b8cdfddd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.620821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.621488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.621747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.622371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] PATH_INFO: `/v3/groups` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.623092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.624529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.638913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:16.654280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 152/308] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Aug 30 00:23:16 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:16.656151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:16.677828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3934db-f9b9-4260-8d49-5f520b333e3f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.716665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6baa67-a08d-43cc-a95c-15a418942002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.717333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baa67-a08d-43cc-a95c-15a418942002 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.717655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baa67-a08d-43cc-a95c-15a418942002 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.717924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6baa67-a08d-43cc-a95c-15a418942002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.718666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6baa67-a08d-43cc-a95c-15a418942002 None admin] RBAC: Adding query filter params (role.id=fa61aa1209a54a50b96d3280153e0485, user.id=4522705e15cc4d09940708fef37c43b6, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:16.718970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6baa67-a08d-43cc-a95c-15a418942002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.720497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6baa67-a08d-43cc-a95c-15a418942002 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.726541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 157/309] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 30 00:23:16 2022] GET /identity/v3/role_assignments?user.id=4522705e15cc4d09940708fef37c43b6&scope.system=all&role.id=fa61aa1209a54a50b96d3280153e0485 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:16.805040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c9445-0bfd-4a7e-a7d8-9a76782f11c2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:16.844512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352aa209-a2f7-4835-b20d-a020481327a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:16.845199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aa209-a2f7-4835-b20d-a020481327a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:16.845479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aa209-a2f7-4835-b20d-a020481327a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:16.845789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352aa209-a2f7-4835-b20d-a020481327a4 None admin] PATH_INFO: `/v3/system/users/1699243368bd4bb79acefe190615bf07/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:16.847353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352aa209-a2f7-4835-b20d-a020481327a4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1699243368bd4bb79acefe190615bf07, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:16.848781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352aa209-a2f7-4835-b20d-a020481327a4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:16.864422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 153/310] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Aug 30 00:23:16 2022] PUT /identity/v3/system/users/1699243368bd4bb79acefe190615bf07/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:17.017188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ad81c-63cc-45c2-996f-98a5e40bbe3c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:17.017379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ad81c-63cc-45c2-996f-98a5e40bbe3c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:17.017678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ad81c-63cc-45c2-996f-98a5e40bbe3c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:17.019177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 158/311] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:17.024636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942880a-3f09-4d10-935b-a5a55fcd0291 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:17.024926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942880a-3f09-4d10-935b-a5a55fcd0291 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:17.025205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942880a-3f09-4d10-935b-a5a55fcd0291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:17.046487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7942880a-3f09-4d10-935b-a5a55fcd0291 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:17.047698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7942880a-3f09-4d10-935b-a5a55fcd0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:17.111665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:17.121566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 154/312] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:17.404369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ad81c-63cc-45c2-996f-98a5e40bbe3c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:17.453482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:17.511306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ad81c-63cc-45c2-996f-98a5e40bbe3c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:17.547422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:17.548063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:17.548343 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:17.548613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:17.559477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:17.565003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:17.565914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:17.566747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 159/313] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:17.572566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942880a-3f09-4d10-935b-a5a55fcd0291 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:17.674265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942880a-3f09-4d10-935b-a5a55fcd0291 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:17.708913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:17.709532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:17.709835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:17.710105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:17.710780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:17.711080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:17.712458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:17.721319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 155/314] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:17.727018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:17.840556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51be0b1-afc6-4dbc-9f41-4211bbff9dda None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:17.843461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:17.879612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:17.880286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:17.880566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:17.880840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] PATH_INFO: `/v3/users/e63b248c17fa482dbad204c823a32929` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:17.882185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] RBAC: Authorizing `identity:get_user(user_id=e63b248c17fa482dbad204c823a32929)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:17.883736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:17.885895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 160/315] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:17 2022] GET /identity/v3/users/e63b248c17fa482dbad204c823a32929 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:17.895072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:17.963236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:17.998077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70cdb-f8b3-4809-8626-cdccd68a0840 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:18.034351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:18.034974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.035250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.035516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.103103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:18.104594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:18.159820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:18.206477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 156/316] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:18.212631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:18.319509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca51ca-b180-40bc-9824-33411e766e4f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:18.354667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ea8cc-f8e7-450e-8065-812093c3a81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:18.355311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea8cc-f8e7-450e-8065-812093c3a81e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.355590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea8cc-f8e7-450e-8065-812093c3a81e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.355865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ea8cc-f8e7-450e-8065-812093c3a81e None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.357092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ea8cc-f8e7-450e-8065-812093c3a81e None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:18.358630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ea8cc-f8e7-450e-8065-812093c3a81e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:18.360602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 161/317] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:18 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:18.366363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:18.468786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e6e81-e057-4596-b57b-85261143b703 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:18.503577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8fb57-91b5-4200-aa3f-25123eea2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:18.504519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8fb57-91b5-4200-aa3f-25123eea2198 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.504791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8fb57-91b5-4200-aa3f-25123eea2198 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.505052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8fb57-91b5-4200-aa3f-25123eea2198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.505825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8fb57-91b5-4200-aa3f-25123eea2198 None admin] RBAC: Adding query filter params (role.id=fa61aa1209a54a50b96d3280153e0485, scope.project.id=892d647615f4492b88dc72f4b3d3d17a, user.id=e63b248c17fa482dbad204c823a32929) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:18.506132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8fb57-91b5-4200-aa3f-25123eea2198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:18.507607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8fb57-91b5-4200-aa3f-25123eea2198 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:18.514288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 157/318] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:18 2022] GET /identity/v3/role_assignments?user.id=e63b248c17fa482dbad204c823a32929&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=fa61aa1209a54a50b96d3280153e0485 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:18.697512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61bd88-8355-49e0-9111-e4a3bbcf025c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.698571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61bd88-8355-49e0-9111-e4a3bbcf025c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.699049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61bd88-8355-49e0-9111-e4a3bbcf025c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.700986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 162/319] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:18.706895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89889-a9c4-45c7-bbab-84715302a4cf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.707790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89889-a9c4-45c7-bbab-84715302a4cf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.708252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89889-a9c4-45c7-bbab-84715302a4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.727861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b9e89889-a9c4-45c7-bbab-84715302a4cf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:18.729396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9e89889-a9c4-45c7-bbab-84715302a4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:18.746121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:18.748453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ea80-7350-4311-b002-cbbabc4eb3fe None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.748738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ea80-7350-4311-b002-cbbabc4eb3fe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.749030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ea80-7350-4311-b002-cbbabc4eb3fe None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.751251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 163/320] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:18.759351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074085-410a-422b-956d-9c312af3443a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.759641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074085-410a-422b-956d-9c312af3443a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.759916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20074085-410a-422b-956d-9c312af3443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.781489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-20074085-410a-422b-956d-9c312af3443a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:18.782762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-20074085-410a-422b-956d-9c312af3443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:18.817354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 158/321] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:18.821043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:18.856678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 164/322] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:18.916073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82432ba-dd4c-4d2b-8bef-90a7a130aeab None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.916331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82432ba-dd4c-4d2b-8bef-90a7a130aeab None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.916622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82432ba-dd4c-4d2b-8bef-90a7a130aeab None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.918169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 159/323] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:18.923298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625de8-bf73-483a-9bae-aed3dd958197 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:18.923587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625de8-bf73-483a-9bae-aed3dd958197 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:18.923851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625de8-bf73-483a-9bae-aed3dd958197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:18.942862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-49625de8-bf73-483a-9bae-aed3dd958197 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:18.944053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-49625de8-bf73-483a-9bae-aed3dd958197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:19.011327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 165/324] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:19.082458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82432ba-dd4c-4d2b-8bef-90a7a130aeab None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.123357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625de8-bf73-483a-9bae-aed3dd958197 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.192923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82432ba-dd4c-4d2b-8bef-90a7a130aeab None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.225034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:19.228196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625de8-bf73-483a-9bae-aed3dd958197 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.232818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.233741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.234200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.234606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.247904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:19.255019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:19.256104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:19.257083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:19.259088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 160/325] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:19.264616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.266409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.267328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.267600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.268060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.270056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:19.271503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:19.273296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 166/326] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:19.278604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.286788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:19.375608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24408c-c897-4860-874a-7a044c9a071d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.385745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efee9-7e96-48b7-92ac-80c5e03508c0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.411414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.412050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.412327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.412601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.413266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:19.413594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:19.414975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:19.421968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.422582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.422907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.423117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] PATH_INFO: `/v3/groups` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.423402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 161/327] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:19.423738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:19.424188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.425242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:19.442801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 167/328] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Aug 30 00:23:19 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:23:19.444271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.478463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:19.529814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:19.563719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246de4e-6f00-4918-aaab-51840f0e735a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.564020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63112abe-6ce7-4529-9eeb-8cb31d131cf8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.606267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.607205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.607460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.607688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.608734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] PATH_INFO: `/v3/users/4522705e15cc4d09940708fef37c43b6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.608837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.608837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.608837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.609689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] RBAC: Authorizing `identity:get_user(user_id=4522705e15cc4d09940708fef37c43b6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:19.611148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:19.619193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 168/329] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/users/4522705e15cc4d09940708fef37c43b6 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:19.619193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.625192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:19.632964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:19.633902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:19.635087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 162/330] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:19.640144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.736956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:19.745089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87877452-594a-4a4c-8789-8e7f8d8f35ad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.762030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220045f-662f-4e22-8612-b0c18907f066 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.796558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.797252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:19.797528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.798013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.798548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] PATH_INFO: `/v3/system/users/4522705e15cc4d09940708fef37c43b6/roles/fa61aa1209a54a50b96d3280153e0485` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.799987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4522705e15cc4d09940708fef37c43b6, role_id=fa61aa1209a54a50b96d3280153e0485)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:19.801591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:19.804530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.805158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.805445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.805742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.806743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:19.807119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:19.808701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:19.814911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 169/331] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Aug 30 00:23:19 2022] PUT /identity/v3/system/users/4522705e15cc4d09940708fef37c43b6/roles/fa61aa1209a54a50b96d3280153e0485 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:23:19.819462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 163/332] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:19.825866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:19.946568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105694eb-9ce3-4158-8d54-4eecf879fc36 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:19.985594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c9164-9234-40e7-acb6-283de6b01ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:19.986229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9164-9234-40e7-acb6-283de6b01ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:19.986568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9164-9234-40e7-acb6-283de6b01ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:19.986834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9164-9234-40e7-acb6-283de6b01ed6 None admin] PATH_INFO: `/v3/users/1699243368bd4bb79acefe190615bf07` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:19.988001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9164-9234-40e7-acb6-283de6b01ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=1699243368bd4bb79acefe190615bf07)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:19.989495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9164-9234-40e7-acb6-283de6b01ed6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:19.991521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 170/333] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/users/1699243368bd4bb79acefe190615bf07 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:19.997809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:20.115637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cd73c-1129-4ed1-bd4e-8b6f66734508 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:20.154007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed31e9-e807-4ca0-af12-0deecb357f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:20.155092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed31e9-e807-4ca0-af12-0deecb357f5b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:20.155623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed31e9-e807-4ca0-af12-0deecb357f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:20.156084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed31e9-e807-4ca0-af12-0deecb357f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:20.157157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed31e9-e807-4ca0-af12-0deecb357f5b None admin] RBAC: Adding query filter params (role.id=440a5fbd07d0485ba8c5215d283387c5, user.id=1699243368bd4bb79acefe190615bf07, scope.system=all) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:20.157690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed31e9-e807-4ca0-af12-0deecb357f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:20.159504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed31e9-e807-4ca0-af12-0deecb357f5b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:20.172892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 164/334] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 30 00:23:19 2022] GET /identity/v3/role_assignments?user.id=1699243368bd4bb79acefe190615bf07&scope.system=all&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:21.673951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab175c0e-2d02-4dce-898b-1035df24c532 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:21.675010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab175c0e-2d02-4dce-898b-1035df24c532 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:21.675488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab175c0e-2d02-4dce-898b-1035df24c532 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:21.677300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 171/335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:21.683215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654508-3fff-4c59-a878-8956b9841b8f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:21.684132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654508-3fff-4c59-a878-8956b9841b8f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:21.684603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b654508-3fff-4c59-a878-8956b9841b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:21.704289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1b654508-3fff-4c59-a878-8956b9841b8f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:21.705877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1b654508-3fff-4c59-a878-8956b9841b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:21.773800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:21.796020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 165/336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:21.977471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae479a-ff36-41ef-98f0-69b998b2d8e1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:21.977981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae479a-ff36-41ef-98f0-69b998b2d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:21.978361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae479a-ff36-41ef-98f0-69b998b2d8e1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:21.980126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 172/337] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:21.985605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fdb12-0ffc-4593-9280-4c93e9d911f0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:21.985898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fdb12-0ffc-4593-9280-4c93e9d911f0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:21.986173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fdb12-0ffc-4593-9280-4c93e9d911f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:22.005641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9d3fdb12-0ffc-4593-9280-4c93e9d911f0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:22.006793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9d3fdb12-0ffc-4593-9280-4c93e9d911f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:22.017430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713de8-bc6b-42c2-b72c-c56165fa68a8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:22.017757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713de8-bc6b-42c2-b72c-c56165fa68a8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:22.018056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713de8-bc6b-42c2-b72c-c56165fa68a8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:22.019804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 173/338] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:22.035019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f691b2-d693-4046-bf5c-e5667a9999b6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:22.035301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f691b2-d693-4046-bf5c-e5667a9999b6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:22.035573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f691b2-d693-4046-bf5c-e5667a9999b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:22.074600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-10f691b2-d693-4046-bf5c-e5667a9999b6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:22.075847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10f691b2-d693-4046-bf5c-e5667a9999b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:22.076763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 166/339] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:22.104672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fdb12-0ffc-4593-9280-4c93e9d911f0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:22.121903 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:22.196255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 174/340] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:22.241779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fdb12-0ffc-4593-9280-4c93e9d911f0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:22.256542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:22.285224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:22.285954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:22.286237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:22.286508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:22.300248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:22.305240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:22.306129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:22.307054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 167/341] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:22.312667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f691b2-d693-4046-bf5c-e5667a9999b6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:22.462458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f691b2-d693-4046-bf5c-e5667a9999b6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:22.503509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:22.504405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:22.504696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:22.504972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:22.509968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:22.510309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:22.512082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:22.521280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 175/342] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:22.527155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:22.552278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:22.575315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:22.668507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e795afc-b69f-4988-9022-d24c9ad916b6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:22.700251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726044c-b93d-4b7b-8c34-43ce2b311409 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:22.738784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:22.739535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:22.739818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:22.740090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:22.756318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:22.757274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:22.758510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:22.759010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:22.759497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:22.761965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:22.762801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:22.763620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 176/343] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:22.764246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:22.834191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:22.864830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:22.866687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:22.907388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:22.976883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 168/344] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:22.977796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:22.983850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074ae7d-ed0d-4d07-bb88-9274aea4694b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.034403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.034992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.035267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.035532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.046630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:23.052218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:23.053274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:23.054228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:23.055369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:23.056119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 177/345] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:23.056686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:23.090707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e72a4f-94f6-4135-8194-72d8b5aac058 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.130944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2d005-d6c6-4740-b188-5c6829cceb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.132052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2d005-d6c6-4740-b188-5c6829cceb32 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.132327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2d005-d6c6-4740-b188-5c6829cceb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.132863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2d005-d6c6-4740-b188-5c6829cceb32 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.133631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2d005-d6c6-4740-b188-5c6829cceb32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:23.133932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2d005-d6c6-4740-b188-5c6829cceb32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.136286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2d005-d6c6-4740-b188-5c6829cceb32 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.146558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 169/346] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:23.148034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e070de-6d1c-43fb-9163-dd608b642457 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.148328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e070de-6d1c-43fb-9163-dd608b642457 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.148598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e070de-6d1c-43fb-9163-dd608b642457 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.153719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 170/347] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:23.154724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e070de-6d1c-43fb-9163-dd608b642457 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:23.176177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca857b-bff7-42f5-a6d6-598179985200 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.222050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.222869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.223285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.223558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.224983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.226939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.229379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 178/348] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:23 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:23.230219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:23.245514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:23.311367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e070de-6d1c-43fb-9163-dd608b642457 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.367294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991cd7e-04e3-443f-84e3-151dd989858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.368349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cd7e-04e3-443f-84e3-151dd989858d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.368826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cd7e-04e3-443f-84e3-151dd989858d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.369346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991cd7e-04e3-443f-84e3-151dd989858d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.371928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeea2a6-9c49-495b-aa2f-817c997d8ac4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.372228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cd7e-04e3-443f-84e3-151dd989858d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:23.372835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cd7e-04e3-443f-84e3-151dd989858d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.374605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991cd7e-04e3-443f-84e3-151dd989858d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.382519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:23.402885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 171/349] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:23.404617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0fc0-46a8-4977-b3b4-f0cc4ec5ba24 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.409874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0fc0-46a8-4977-b3b4-f0cc4ec5ba24 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.410371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a0fc0-46a8-4977-b3b4-f0cc4ec5ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.413696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.414404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.414710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.415042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] PATH_INFO: `/v3/users/4522705e15cc4d09940708fef37c43b6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.416201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] RBAC: Authorizing `identity:get_user(user_id=4522705e15cc4d09940708fef37c43b6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.417844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.420124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:23:23 2022] GET /identity/v3/users/4522705e15cc4d09940708fef37c43b6 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:23.420600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:23.436472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-739a0fc0-46a8-4977-b3b4-f0cc4ec5ba24 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:23.438077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-739a0fc0-46a8-4977-b3b4-f0cc4ec5ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:23.507537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:23.515070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 172/351] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:23.516117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0fc0-46a8-4977-b3b4-f0cc4ec5ba24 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:23.534620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f26927-8889-4f4d-8371-e9843e7a6828 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.572247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.573133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.573579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.573982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.581657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.583391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.588624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 180/352] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:23 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:23.589677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:23.666339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a0fc0-46a8-4977-b3b4-f0cc4ec5ba24 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.703162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efbef6-89fb-42fe-adea-7826e83d5a4b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.719321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:23.742752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.743805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.744223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.744628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.745492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] RBAC: Adding query filter params (role.id=fa61aa1209a54a50b96d3280153e0485, user.id=4522705e15cc4d09940708fef37c43b6, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:23.745952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.747597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.750295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.750930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.751206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.751472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.755297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:23.764964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 181/353] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Aug 30 00:23:23 2022] GET /identity/v3/role_assignments?user.id=4522705e15cc4d09940708fef37c43b6&scope.system=all&role.id=fa61aa1209a54a50b96d3280153e0485 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:23.766463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:23.887156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39301ad-69e3-475e-a0fd-4cbc2e8815a3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:23.910144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.911663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.933197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529b1cc-d793-4495-b5c3-add00988c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:23.936279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529b1cc-d793-4495-b5c3-add00988c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.936763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529b1cc-d793-4495-b5c3-add00988c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.937178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529b1cc-d793-4495-b5c3-add00988c8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.938152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529b1cc-d793-4495-b5c3-add00988c8c3 None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:23.938602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529b1cc-d793-4495-b5c3-add00988c8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:23.940461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529b1cc-d793-4495-b5c3-add00988c8c3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:23.951525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 182/354] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:23 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:23.953291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eaceb-64a8-48b2-8e05-4a7880fe1d24 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.953791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eaceb-64a8-48b2-8e05-4a7880fe1d24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.954205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eaceb-64a8-48b2-8e05-4a7880fe1d24 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.955733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 183/355] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:23.961898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89043fa0-677e-4b32-8182-4427886d5878 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:23.962447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89043fa0-677e-4b32-8182-4427886d5878 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:23.962961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89043fa0-677e-4b32-8182-4427886d5878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:23.994655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-89043fa0-677e-4b32-8182-4427886d5878 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:23.995909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-89043fa0-677e-4b32-8182-4427886d5878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:24.042261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 173/356] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:24.049481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.083125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:24.117408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:24.144102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 184/357] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:24.150913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89043fa0-677e-4b32-8182-4427886d5878 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.172943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536df5-ee17-44de-b664-54d03d3f0d66 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:24.217429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:24.218257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.218818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.219157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.220354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:24.222327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:24.224676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 174/358] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:24.230269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.291846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89043fa0-677e-4b32-8182-4427886d5878 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:24.338293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:24.342324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d66e9-5e9f-4554-b7a8-6652941dd9c9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:24.351772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:24.352430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.352704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.352965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.372598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:24.379192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:24.380110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:24.380968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:24.385447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 185/359] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:24.390829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.393685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:24.394406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.394681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.394957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.396101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:24.397554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:24.399453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 175/360] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:24.405643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.470558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:24.531583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2acaf-61f2-4584-b836-60c4a6c11871 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:24.548606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b1ab-c3fb-4489-91ca-3438bd748dc1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:24.571963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e989615-52e0-4b8d-841e-6fdb06f83c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:24.572596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989615-52e0-4b8d-841e-6fdb06f83c51 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.572872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989615-52e0-4b8d-841e-6fdb06f83c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.573139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989615-52e0-4b8d-841e-6fdb06f83c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.574423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e989615-52e0-4b8d-841e-6fdb06f83c51 None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:24.574739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e989615-52e0-4b8d-841e-6fdb06f83c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:24.576423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e989615-52e0-4b8d-841e-6fdb06f83c51 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:24.582625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 176/361] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:24.583988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80fbef-8dc5-4239-9aee-847fc390a948 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.584269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80fbef-8dc5-4239-9aee-847fc390a948 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.584540 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80fbef-8dc5-4239-9aee-847fc390a948 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.589149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 177/362] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:24.594792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb782-81b5-409c-a376-6aae21827440 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.595149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb782-81b5-409c-a376-6aae21827440 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.595327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bb782-81b5-409c-a376-6aae21827440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.604632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:24.605338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.607606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.607892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.608602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:24.608966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:24.611509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:24.625365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ba8bb782-81b5-409c-a376-6aae21827440 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:24.626630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ba8bb782-81b5-409c-a376-6aae21827440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:24.627567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 186/363] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:24.636300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.662165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:24.738633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 178/364] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:24.739853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb782-81b5-409c-a376-6aae21827440 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.794136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990708a-56a6-4269-afb0-a992034c4749 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:24.818536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:24.868192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bb782-81b5-409c-a376-6aae21827440 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:24.870243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:24.870872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.871151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.871422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.915194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:24.916587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:24.917057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:24.917535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:24.934216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:24.940743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:24.941674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:24.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:24.943863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 179/365] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:24.950475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:24.963374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:24.964856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:24.979211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:25.078742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bc9a8-cf6a-47a6-9c21-83ce4a84c056 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.090706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 187/366] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:23:25.096869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.114461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:25.117783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.118631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.119069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.119563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.120419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:25.120889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:25.122608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:25.132659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 180/367] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:25.138527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.222471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:25.246457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72dc5a-e4f3-4e28-942a-068865795b6d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.258970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f2857-2d05-4f5d-bf3b-088ffb3e8ae3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.287044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.288136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.288660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.289124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.308164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.308164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.308164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.308164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.309371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:25.311253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:25.314005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 188/368] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:25.314804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.368112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:25.369933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:25.438855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:25.465153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9385c3-6654-4cdd-a6b0-3b56bb9f7e99 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.476044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:25.502023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 181/369] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:23:25.503035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.510363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.512024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.512466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.512891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.526226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:25.532364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:25.533451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:25.534475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:25.537173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 189/370] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:25.543061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.652267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4463b4d-232b-4221-8e36-1f08b44330d0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.665224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a435a-1faf-4d5f-871d-270db1338fb2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.706480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.707751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.708331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.708822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.710499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:25.711663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.712401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.712545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:25.712905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.713362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.714831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:25.715239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 182/371] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:25.716234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.716906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:25.720108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 190/372] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:25.721018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.739851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:25.777837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:25.848494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c600ea-1ea0-4b2c-bc8b-5a0b0b425ad7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.850479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9487631-46fa-40a9-afe5-5820fcab8410 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:25.891933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.892700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.893077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.893466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.894301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=892d647615f4492b88dc72f4b3d3d17a) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:25.894704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:25.895841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:25.896359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:25.896787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:25.897204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:25.897640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:25.898458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:25.899118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:25.901191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:25.904415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 191/373] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:25.905190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:25.916704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 183/374] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:25.923477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:26.009577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:26.063991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fe674-2e31-4361-acea-605a0fff0273 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:26.102253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eeede-398b-4996-9672-57722cf2d0d7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:26.112154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:26.123091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:26.123857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.124232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.124564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.126245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:26.127957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:26.129954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 192/375] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:26.146435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:26.148132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e75a-26fa-4629-a08a-d9e8e8bef374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:26.148766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e75a-26fa-4629-a08a-d9e8e8bef374 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.149045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e75a-26fa-4629-a08a-d9e8e8bef374 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.149317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e75a-26fa-4629-a08a-d9e8e8bef374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.225190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e75a-26fa-4629-a08a-d9e8e8bef374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:26.226747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e75a-26fa-4629-a08a-d9e8e8bef374 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:26.261818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1b6c6-9e89-4fd6-aab8-820fb9f0903b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:26.298775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:26.299395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.299675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.299943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.300673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=892d647615f4492b88dc72f4b3d3d17a) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:26.300978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:26.302465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:26.308721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 193/376] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:26 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:26.339466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 184/377] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:26.345483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:26.359646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:26.410815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae7bc-d973-4b76-a788-d392d864a463 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.411215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae7bc-d973-4b76-a788-d392d864a463 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.411499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae7bc-d973-4b76-a788-d392d864a463 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.413128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 185/378] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:26.423776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0890d-193c-43f6-b7ba-72e2cc483792 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.424553 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0890d-193c-43f6-b7ba-72e2cc483792 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.426727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0890d-193c-43f6-b7ba-72e2cc483792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.460998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1ef0890d-193c-43f6-b7ba-72e2cc483792 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:26.464035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1ef0890d-193c-43f6-b7ba-72e2cc483792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:26.468443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:26.537420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4116599-5ca1-489d-917f-90ea4c31d021 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:26.597719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 186/379] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:26.603202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:26.604132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.604607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.605085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] PATH_INFO: `/v3/projects/4f231d500254452db95956e5ca509c67` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.606424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] RBAC: Authorizing `identity:get_project(project_id=4f231d500254452db95956e5ca509c67)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:26.608459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:26.610847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 194/380] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:26 2022] GET /identity/v3/projects/4f231d500254452db95956e5ca509c67 => generated 344 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:26.617429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0890d-193c-43f6-b7ba-72e2cc483792 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:26.739378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0890d-193c-43f6-b7ba-72e2cc483792 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:26.776316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643b678-6733-4500-aa7a-5b25f6154a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:26.776960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b678-6733-4500-aa7a-5b25f6154a26 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.777233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b678-6733-4500-aa7a-5b25f6154a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.777491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b678-6733-4500-aa7a-5b25f6154a26 None admin] PATH_INFO: `/v3/groups/ab19bb7fb57f4958a19de4250022c8d7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.784175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643b678-6733-4500-aa7a-5b25f6154a26 None admin] RBAC: Authorizing `identity:get_group(group_id=ab19bb7fb57f4958a19de4250022c8d7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:26.785795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643b678-6733-4500-aa7a-5b25f6154a26 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:26.787977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 187/381] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:26 2022] GET /identity/v3/groups/ab19bb7fb57f4958a19de4250022c8d7 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:26.793716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:26.883008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:26.910489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6afe-1f60-4d72-98dc-54c2fedcdab3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:26.945897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea109b-3cce-47b5-bf19-b707dd5b1d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:26.946519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea109b-3cce-47b5-bf19-b707dd5b1d76 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:26.946795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea109b-3cce-47b5-bf19-b707dd5b1d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:26.947063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea109b-3cce-47b5-bf19-b707dd5b1d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:26.947808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea109b-3cce-47b5-bf19-b707dd5b1d76 None admin] RBAC: Adding query filter params (group.id=ab19bb7fb57f4958a19de4250022c8d7, role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=4f231d500254452db95956e5ca509c67) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:26.948120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea109b-3cce-47b5-bf19-b707dd5b1d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:26.949585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea109b-3cce-47b5-bf19-b707dd5b1d76 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:26.956289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 195/382] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:26 2022] GET /identity/v3/role_assignments?group.id=ab19bb7fb57f4958a19de4250022c8d7&scope.project.id=4f231d500254452db95956e5ca509c67&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:27.005895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603e120-8a3d-4fe4-ac00-c142301a4504 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:27.006506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603e120-8a3d-4fe4-ac00-c142301a4504 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:27.006506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603e120-8a3d-4fe4-ac00-c142301a4504 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:27.007771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 188/383] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:27.013736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a416cc-2c13-4b50-a97b-62ca29d73511 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:27.014038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a416cc-2c13-4b50-a97b-62ca29d73511 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:27.014279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a416cc-2c13-4b50-a97b-62ca29d73511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:27.034232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b4a416cc-2c13-4b50-a97b-62ca29d73511 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:27.035475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b4a416cc-2c13-4b50-a97b-62ca29d73511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:27.077002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603e120-8a3d-4fe4-ac00-c142301a4504 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:27.081534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:27.157101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 196/384] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:27.295268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603e120-8a3d-4fe4-ac00-c142301a4504 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:27.368234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:27.368827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:27.369109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:27.369804 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:27.410508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:27.415915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:27.416815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:27.418024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 189/385] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:27.426763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a416cc-2c13-4b50-a97b-62ca29d73511 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:27.561990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:27.583388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:27.605467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a416cc-2c13-4b50-a97b-62ca29d73511 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:27.674343 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:27.674901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:27.675192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:27.675441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:27.676114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:27.676420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:27.677955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:27.710291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 197/386] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:27.716230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:27.726078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:27.800581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb543eaa-a12c-4a66-a2c4-72ee0f7ec084 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:27.897302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656b847-b150-4f11-a468-1125351b151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:27.897964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b847-b150-4f11-a468-1125351b151c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:27.898235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b847-b150-4f11-a468-1125351b151c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:27.898497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b847-b150-4f11-a468-1125351b151c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:27.901172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0189db8-ed2d-4081-b82b-9d4c1445ccac None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:27.921462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656b847-b150-4f11-a468-1125351b151c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1656b847-b150-4f11-a468-1125351b151c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:27.928520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:27.929373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:27.930199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:27.930783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 190/387] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:27.938301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656b847-b150-4f11-a468-1125351b151c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:27.959225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:27.966978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:27.967615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:27.967933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:27.968200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:27.969322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:27.970985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:27.972621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 198/388] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:27 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:27.980121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:28.074409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656b847-b150-4f11-a468-1125351b151c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:28.109958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:28.124853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:28.125485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.125824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.126098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.126791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:28.127086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:28.128485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:28.152843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55292c3d-5844-4a5a-84fb-62b99da7d78f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:28.156579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 191/389] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:28.162580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:28.190692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:28.191707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.192201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.192639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.194571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:28.196239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:28.198331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 199/390] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:27 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:28.209770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:28.337487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:28.374452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387448d6-458e-400a-8d7d-bda80bca4951 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:28.397203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64787-71ea-46b7-87b6-fd7a3be0776d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:28.439780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:28.440518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.440875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.441092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/groups/bf2fe78e07b24b03847368e5184a5d92/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.443221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa951d1ef5d7477b8a715daf4ec64377, group_id=bf2fe78e07b24b03847368e5184a5d92, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:28.443850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:28.444646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.444764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:28.444959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.445227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.447566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:28.449034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:28.451367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 192/391] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:28 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:28.456992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:28.477303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 200/392] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 30 00:23:28 2022] PUT /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/groups/bf2fe78e07b24b03847368e5184a5d92/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:28.546020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:28.622078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3dc69-5e9d-4496-811d-4423dc9322a4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:28.680173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5e581-e538-4bcc-bf26-4d15b2cedc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:28.680931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5e581-e538-4bcc-bf26-4d15b2cedc1e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.681214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5e581-e538-4bcc-bf26-4d15b2cedc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.681489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5e581-e538-4bcc-bf26-4d15b2cedc1e None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.682836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5e581-e538-4bcc-bf26-4d15b2cedc1e None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:28.684451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5e581-e538-4bcc-bf26-4d15b2cedc1e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:28.686931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 193/393] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:28 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:28.693080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:28.818070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed5d1-2508-453e-8fc5-d4fe90491fbc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.818466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed5d1-2508-453e-8fc5-d4fe90491fbc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.818636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed5d1-2508-453e-8fc5-d4fe90491fbc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.819969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 194/394] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:28.825312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88670b4d-2272-4144-812e-e8f09b0e6b04 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.825662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88670b4d-2272-4144-812e-e8f09b0e6b04 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.825930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88670b4d-2272-4144-812e-e8f09b0e6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.828749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebc4d0-c865-4771-86f7-d4caee3b5258 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:28.855093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-88670b4d-2272-4144-812e-e8f09b0e6b04 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:28.856355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88670b4d-2272-4144-812e-e8f09b0e6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:28.858002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:28.868879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71db8c-b139-434b-96a2-f3dbc84c3223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:28.869636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71db8c-b139-434b-96a2-f3dbc84c3223 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.870022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71db8c-b139-434b-96a2-f3dbc84c3223 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.870311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71db8c-b139-434b-96a2-f3dbc84c3223 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/groups/bf2fe78e07b24b03847368e5184a5d92/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.872674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71db8c-b139-434b-96a2-f3dbc84c3223 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa951d1ef5d7477b8a715daf4ec64377, group_id=bf2fe78e07b24b03847368e5184a5d92, role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:28.874289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71db8c-b139-434b-96a2-f3dbc84c3223 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:28.896824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 201/395] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 30 00:23:28 2022] PUT /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377/groups/bf2fe78e07b24b03847368e5184a5d92/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:28.939016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2653-e0e1-4e72-b547-56756be47264 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.939637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2653-e0e1-4e72-b547-56756be47264 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.939637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2653-e0e1-4e72-b547-56756be47264 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.941209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 202/396] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:28.945745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 195/397] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:28.947132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b12ce-1b57-4763-8af5-40b071163647 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:28.947485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b12ce-1b57-4763-8af5-40b071163647 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:28.947827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b12ce-1b57-4763-8af5-40b071163647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:28.986228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1f0b12ce-1b57-4763-8af5-40b071163647 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:28.987819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1f0b12ce-1b57-4763-8af5-40b071163647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:29.119080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 203/398] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:29.229015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88670b4d-2272-4144-812e-e8f09b0e6b04 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:29.283340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:29.350354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88670b4d-2272-4144-812e-e8f09b0e6b04 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:29.390387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:29.391047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:29.391326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:29.392160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:29.410452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:29.415361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:29.416318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:29.417079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 196/399] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:29.425456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b12ce-1b57-4763-8af5-40b071163647 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:29.557581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b12ce-1b57-4763-8af5-40b071163647 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:29.566665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:29.579169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:29.601009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:29.601648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:29.602382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:29.602653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:29.603488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:29.603792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:29.605313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:29.623877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 204/400] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:29.629429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:29.763265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0b862-5c89-4766-8290-7e5313fb69fb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:29.783503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:29.787900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29064593-6ab6-4a3f-9230-b41ec43f8463 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:29.815355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:29.816573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:29.817260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:29.817791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:29.829569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9ed4-5921-4ed9-8ab6-c449f351c19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:29.830382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9ed4-5921-4ed9-8ab6-c449f351c19b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:29.830680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9ed4-5921-4ed9-8ab6-c449f351c19b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:29.830955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9ed4-5921-4ed9-8ab6-c449f351c19b None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:29.831903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:29.832209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9ed4-5921-4ed9-8ab6-c449f351c19b None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:29.833718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9ed4-5921-4ed9-8ab6-c449f351c19b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:29.837489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:29.838452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:29.839267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:29.840345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 205/401] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:29 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:29.841261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be275-144d-4c6a-b19f-ec140e0fdce1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:29.841568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be275-144d-4c6a-b19f-ec140e0fdce1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:29.841845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be275-144d-4c6a-b19f-ec140e0fdce1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:29.842677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 197/402] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:29.843315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 206/403] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:29.843822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:29.849564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4be275-144d-4c6a-b19f-ec140e0fdce1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:29.918250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:29.969781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f7392-07d3-4d7b-b481-260083c3eb17 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:29.992177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4be275-144d-4c6a-b19f-ec140e0fdce1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.014104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0ea71-440a-4cf3-889a-ca6e0269be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.015106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ea71-440a-4cf3-889a-ca6e0269be53 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.015570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ea71-440a-4cf3-889a-ca6e0269be53 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.016017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0ea71-440a-4cf3-889a-ca6e0269be53 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.018509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ea71-440a-4cf3-889a-ca6e0269be53 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.020154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0ea71-440a-4cf3-889a-ca6e0269be53 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.022317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 198/404] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:29 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:30.023669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6c35-2d61-4d1f-9b16-9d4456149212 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.024150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6c35-2d61-4d1f-9b16-9d4456149212 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.024676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6c35-2d61-4d1f-9b16-9d4456149212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.035447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.036076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.036359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.036628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.037304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:30.037635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.039011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.047799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bf6a6c35-2d61-4d1f-9b16-9d4456149212 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:30.049274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf6a6c35-2d61-4d1f-9b16-9d4456149212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:30.053373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 207/405] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:30.054315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:30.090009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:30.124296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 199/406] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:30.125749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6c35-2d61-4d1f-9b16-9d4456149212 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:30.206390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a235745-fd7c-451b-b401-77469766d8ae None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.233958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:30.267070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6c35-2d61-4d1f-9b16-9d4456149212 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.297685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.298384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.298665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.298939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a/groups/bf2fe78e07b24b03847368e5184a5d92/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.301129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] RBAC: Authorizing `identity:create_grant(project_id=892d647615f4492b88dc72f4b3d3d17a, group_id=bf2fe78e07b24b03847368e5184a5d92, role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.302738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.305937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.306607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.306939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.307213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.312379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.314145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.316503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 200/407] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:30 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:30.326093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:30.336641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 208/408] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 30 00:23:30 2022] PUT /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a/groups/bf2fe78e07b24b03847368e5184a5d92/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:30.390751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:30.477741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5a7d-1851-49e4-829e-95e44bfa5c0f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.498046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:30.543271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.544538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.545031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.546555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.548847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.553443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.555617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 201/409] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:30 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:30.562668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:30.656823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5d4d5-f636-48e6-9bc5-2cf3e831a856 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.697296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.698426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.698924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.699411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.711583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eeed00-f728-4d7a-adb9-3b190115af34 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.713752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:30.714373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:30.719533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:30.720427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:30.721196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:30.723940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 209/410] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:30.730131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:30.755759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.756456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.756735 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.757004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a/groups/bf2fe78e07b24b03847368e5184a5d92/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.759593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] RBAC: Authorizing `identity:create_grant(project_id=892d647615f4492b88dc72f4b3d3d17a, group_id=bf2fe78e07b24b03847368e5184a5d92, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.761470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.766999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:30.783874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 202/411] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 30 00:23:30 2022] PUT /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a/groups/bf2fe78e07b24b03847368e5184a5d92/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:30.864198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea3a3-20b7-4f0f-9167-f4d07a6d6945 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.904071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.905534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.906313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.907092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.908115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:30.908793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.911208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.922172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 210/412] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:30.929646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:31.083979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454263c-c452-4bbc-9348-222ea537e294 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:31.127446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347f010-241c-473a-8a7c-7e19be702a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:31.128157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347f010-241c-473a-8a7c-7e19be702a58 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.128433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347f010-241c-473a-8a7c-7e19be702a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.129036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347f010-241c-473a-8a7c-7e19be702a58 None admin] PATH_INFO: `/v3/groups/ab19bb7fb57f4958a19de4250022c8d7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.130227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347f010-241c-473a-8a7c-7e19be702a58 None admin] RBAC: Authorizing `identity:get_group(group_id=ab19bb7fb57f4958a19de4250022c8d7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:31.131696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347f010-241c-473a-8a7c-7e19be702a58 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:31.133643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 203/413] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:30 2022] GET /identity/v3/groups/ab19bb7fb57f4958a19de4250022c8d7 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:31.140100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:31.245055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274921-6487-4376-bf0e-16cfeb91cfd8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.245394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274921-6487-4376-bf0e-16cfeb91cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.245629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274921-6487-4376-bf0e-16cfeb91cfd8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.247121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 204/414] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:31.251406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:31.255183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e14d-1921-41ac-9321-66568d7f52ff None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.255451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e14d-1921-41ac-9321-66568d7f52ff None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.255721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534e14d-1921-41ac-9321-66568d7f52ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.262248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdadc4e-6391-4610-88b7-435a14b416d0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:31.297805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2534e14d-1921-41ac-9321-66568d7f52ff None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:31.299067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2534e14d-1921-41ac-9321-66568d7f52ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:31.305330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:31.306158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.306437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.306710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] PATH_INFO: `/v3/projects/4f231d500254452db95956e5ca509c67` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.307982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] RBAC: Authorizing `identity:get_project(project_id=4f231d500254452db95956e5ca509c67)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:31.309424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:31.311167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 211/415] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:31 2022] GET /identity/v3/projects/4f231d500254452db95956e5ca509c67 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:31.323032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:31.365946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:31.455275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 205/416] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:31.465729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d380e9c-08ce-452e-885a-a570eb5a4a28 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:31.495630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33dea4-1edb-4c80-b81f-49e407f4bed2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.495823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33dea4-1edb-4c80-b81f-49e407f4bed2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.496083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33dea4-1edb-4c80-b81f-49e407f4bed2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.498819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 206/417] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:31.502996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebd42-b67b-4644-a243-d19898ab0ebd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.503280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebd42-b67b-4644-a243-d19898ab0ebd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.503898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebd42-b67b-4644-a243-d19898ab0ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.504065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:31.504959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.505387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.505840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] PATH_INFO: `/v3/projects/4f231d500254452db95956e5ca509c67/groups/ab19bb7fb57f4958a19de4250022c8d7/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.508060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] RBAC: Authorizing `identity:create_grant(project_id=4f231d500254452db95956e5ca509c67, group_id=ab19bb7fb57f4958a19de4250022c8d7, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:31.509651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:31.523671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e12ebd42-b67b-4644-a243-d19898ab0ebd None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:31.525079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e12ebd42-b67b-4644-a243-d19898ab0ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:31.534317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 212/418] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Aug 30 00:23:31 2022] PUT /identity/v3/projects/4f231d500254452db95956e5ca509c67/groups/ab19bb7fb57f4958a19de4250022c8d7/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:31.627392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 207/419] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:31.761006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:31.783730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:31.875992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee00bc-3352-421b-802d-3fadb115160e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:31.920363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:31.921073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:31.921376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:31.921698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:31.937599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:31.942904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:31.943757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:31.944532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 213/420] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:31.950227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ebd42-b67b-4644-a243-d19898ab0ebd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:32.040448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:32.060694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:32.083849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ebd42-b67b-4644-a243-d19898ab0ebd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:32.155823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:32.156818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:32.158160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:32.158646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:32.159974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:32.165980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:32.167422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:32.178907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:32.184725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 208/421] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:32.190891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:32.210973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a8063-667e-486a-82dc-243921dbbc10 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:32.249241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:32.250300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:32.250818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:32.251280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:32.263201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:32.269208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:32.270136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:32.271124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:32.273939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 214/422] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:32.284412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:32.462919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7982a4-b4ba-4ee5-84a3-9ec58750d83b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:32.486372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f857f5-4c74-42c8-bfb9-d39b119cedb8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:32.538967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:32.540064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:32.540558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:32.541045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:32.566789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:32.567407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:32.567684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:32.567950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:32.568521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:32.568725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:32.569026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:32.570840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:32.588463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:32.596872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 215/423] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:32.614057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:32.629178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:32.630663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:32.742029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 209/424] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:32.748046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:32.813183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:32.851192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0d14-d353-4416-9ef7-c703e9e3c4aa None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:32.866746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075641d-06dd-4151-8d42-3c2e40e0be21 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:32.895107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:32.895978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:32.896273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:32.896552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:32.907373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc75cf-10b4-42d5-882e-6fa1a0e49b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:32.908050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc75cf-10b4-42d5-882e-6fa1a0e49b08 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:32.908328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc75cf-10b4-42d5-882e-6fa1a0e49b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:32.908601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc75cf-10b4-42d5-882e-6fa1a0e49b08 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:32.909822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc75cf-10b4-42d5-882e-6fa1a0e49b08 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:32.911416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc75cf-10b4-42d5-882e-6fa1a0e49b08 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:32.913423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 210/425] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:32 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:32.918930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7184-7de3-4c03-9284-f69e83215abb None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:32.919492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7184-7de3-4c03-9284-f69e83215abb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:32.919672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7184-7de3-4c03-9284-f69e83215abb None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:32.921750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 211/426] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:32.923772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7184-7de3-4c03-9284-f69e83215abb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:32.995507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:32.999955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:33.002452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:33.046579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7184-7de3-4c03-9284-f69e83215abb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:33.074632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:33.088556 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce629dc-ef92-416b-b29f-a060ad8aa81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:33.089216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce629dc-ef92-416b-b29f-a060ad8aa81f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.089473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce629dc-ef92-416b-b29f-a060ad8aa81f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.089777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce629dc-ef92-416b-b29f-a060ad8aa81f None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.090967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce629dc-ef92-416b-b29f-a060ad8aa81f None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:33.092509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce629dc-ef92-416b-b29f-a060ad8aa81f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:33.099084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 212/427] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:32 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:33.099084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533eeb3-04b1-4860-825f-eb2ed5ac2ae3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.099084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533eeb3-04b1-4860-825f-eb2ed5ac2ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.099084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533eeb3-04b1-4860-825f-eb2ed5ac2ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.116838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3533eeb3-04b1-4860-825f-eb2ed5ac2ae3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:33.118381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3533eeb3-04b1-4860-825f-eb2ed5ac2ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:33.145936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 216/428] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:23:33.150413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:33.204092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 213/429] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:33.205476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533eeb3-04b1-4860-825f-eb2ed5ac2ae3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:33.295137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:33.297751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e17d8-adac-4190-9f0d-80bffb980ef4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:33.359858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c778-af07-4b67-a720-105b6b8b3cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:33.360720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c778-af07-4b67-a720-105b6b8b3cfb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.361002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c778-af07-4b67-a720-105b6b8b3cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.361277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c778-af07-4b67-a720-105b6b8b3cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.362041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c778-af07-4b67-a720-105b6b8b3cfb None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:33.362347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c778-af07-4b67-a720-105b6b8b3cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:33.364540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7c778-af07-4b67-a720-105b6b8b3cfb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:33.374274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 217/430] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:33 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:33.380036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533eeb3-04b1-4860-825f-eb2ed5ac2ae3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:33.413371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170b05-d2c2-4056-a59b-f0145cf82d19 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.413777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170b05-d2c2-4056-a59b-f0145cf82d19 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.413955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92170b05-d2c2-4056-a59b-f0145cf82d19 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.415418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 218/431] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:33.418441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:33.421360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e51a6-285d-4a00-84e2-fa45bc0fcec6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.421744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e51a6-285d-4a00-84e2-fa45bc0fcec6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.422021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e51a6-285d-4a00-84e2-fa45bc0fcec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.454916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-725e51a6-285d-4a00-84e2-fa45bc0fcec6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:33.456170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-725e51a6-285d-4a00-84e2-fa45bc0fcec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:33.458115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:33.458838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.459114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.459383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] PATH_INFO: `/v3/projects/aa951d1ef5d7477b8a715daf4ec64377` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.460630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] RBAC: Authorizing `identity:get_project(project_id=aa951d1ef5d7477b8a715daf4ec64377)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:33.462156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:33.465871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 214/432] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:33 2022] GET /identity/v3/projects/aa951d1ef5d7477b8a715daf4ec64377 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:33.478728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:33.589849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 219/433] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:33.590652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e51a6-285d-4a00-84e2-fa45bc0fcec6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:33.623015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0f3d3-293b-4a26-bbae-269225976f07 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:33.661335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:33.662003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.662270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.662544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.663688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:33.665156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:33.666897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 215/434] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:33 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:33.673218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:33.719542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:33.730779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e51a6-285d-4a00-84e2-fa45bc0fcec6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:33.740341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:33.773770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:33.774900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.775376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.775836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.789198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:33.795195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:33.796093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:33.796889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:33.798212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e13f4-15f7-4632-abb2-d3ac100efd1f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:33.799893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 220/435] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:33.805870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:33.842935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:33.843600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.843946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.844629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.845711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=aa951d1ef5d7477b8a715daf4ec64377) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:33.846091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:33.847780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:33.855667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 216/436] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:33 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=aa951d1ef5d7477b8a715daf4ec64377&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:33.901351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:33.931653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c267581-2eaf-4390-8ebe-ed296327e65c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:33.981796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:33.982431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:33.982708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:33.982977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:33.985044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:33.985044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:33.985425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:33.994939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 221/437] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:34.002770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.028320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbbf20-1bfb-4b85-9773-d7e5c4f6c92c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.030135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.051573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.071385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8383fa-5432-4d65-a052-5ad607b68e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.072073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8383fa-5432-4d65-a052-5ad607b68e69 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.072428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8383fa-5432-4d65-a052-5ad607b68e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.072695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8383fa-5432-4d65-a052-5ad607b68e69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.088878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8383fa-5432-4d65-a052-5ad607b68e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4d8383fa-5432-4d65-a052-5ad607b68e69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:34.094982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:34.095850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:34.096796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 217/438] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:34.097482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c763e-a7b4-4aaa-a3a6-505a0b090e91 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.098035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c763e-a7b4-4aaa-a3a6-505a0b090e91 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.098035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c763e-a7b4-4aaa-a3a6-505a0b090e91 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.099451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 218/439] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:34.104691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955508d-d295-455f-8ad7-4c1b47a98a6a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.104964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955508d-d295-455f-8ad7-4c1b47a98a6a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.105227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955508d-d295-455f-8ad7-4c1b47a98a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.125607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a955508d-d295-455f-8ad7-4c1b47a98a6a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:34.126794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a955508d-d295-455f-8ad7-4c1b47a98a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:34.140789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbabb5c-dab2-48ba-8f4f-dea4965896d9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.181122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.181884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.182252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.182532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.205064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 219/440] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:34.206023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955508d-d295-455f-8ad7-4c1b47a98a6a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.273918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.275451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.295448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.336034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955508d-d295-455f-8ad7-4c1b47a98a6a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.350592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.384665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c858355-68d7-4956-a629-a29df147636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.385362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c858355-68d7-4956-a629-a29df147636f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.386183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c858355-68d7-4956-a629-a29df147636f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.386378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c858355-68d7-4956-a629-a29df147636f None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.387064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c858355-68d7-4956-a629-a29df147636f None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:34.387377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c858355-68d7-4956-a629-a29df147636f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.388875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c858355-68d7-4956-a629-a29df147636f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.402315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 220/441] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:34.403884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c858355-68d7-4956-a629-a29df147636f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.412680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 222/442] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:34.418234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.512093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c858355-68d7-4956-a629-a29df147636f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.518417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815055-6aa6-4a4c-adca-971807fc77fb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.535782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.546564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.547173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.547444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.547707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.553599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.554306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.554588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.554859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.555998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.557505 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.559233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 223/443] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:34.560181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.594067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.622844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.624222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.663994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85677c-f567-4324-b23d-38f425ca30e3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.698157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.699178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.699474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.699765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.710324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:34.715592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:34.716621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:34.717426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 224/444] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:34.718729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.728941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 221/445] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:23:34.729797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.767032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.799928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.823605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35e0d4-e4f5-4152-971d-bdbc6debdad6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.831158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76458d-c3e8-4724-8cac-4e85a2cd6d83 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.857782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.858427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.858701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.858968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.860084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.861587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.863138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 225/446] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:34.863891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.864440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.865045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.865315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.865598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.866252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:34.866548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.867894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.876863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 222/447] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:34.877788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.987501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830abc2-3e9d-4162-adcf-dfce794bfe5a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.988166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69d7a2-345a-4cce-a79d-cc6c08208c6b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:35.004392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:35.025294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.025826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.026031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.026287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.026464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.026552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.026742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.027014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] PATH_INFO: `/v3/projects/892d647615f4492b88dc72f4b3d3d17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.027256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=892d647615f4492b88dc72f4b3d3d17a) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:35.027555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.028134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] RBAC: Authorizing `identity:get_project(project_id=892d647615f4492b88dc72f4b3d3d17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.029019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.029671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.030789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:35.036069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 226/448] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/projects/892d647615f4492b88dc72f4b3d3d17a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:35.036069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:35.041837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 223/449] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:35.042812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:35.154603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1a271-d857-46cc-a9f0-e41816b49add None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:35.156404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1225e93-e9de-413b-902b-21eaa7def358 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:35.192932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.193571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.193862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.193978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.194168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.194553 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.194833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.195102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] PATH_INFO: `/v3/groups/bf2fe78e07b24b03847368e5184a5d92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.196984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] RBAC: Authorizing `identity:get_group(group_id=bf2fe78e07b24b03847368e5184a5d92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.198534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.205535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 224/450] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:35 2022] GET /identity/v3/groups/bf2fe78e07b24b03847368e5184a5d92 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:35.206757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:35.251263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:35.271504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.272975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.282370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:35.322556 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b70df-667d-4fdb-9f72-fce6cf49c76c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:35.355801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.356577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.356860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.357146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.357927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] RBAC: Adding query filter params (group.id=bf2fe78e07b24b03847368e5184a5d92, role.id=440a5fbd07d0485ba8c5215d283387c5, scope.project.id=892d647615f4492b88dc72f4b3d3d17a) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:35.358229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.359687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.365604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 225/451] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:35 2022] GET /identity/v3/role_assignments?group.id=bf2fe78e07b24b03847368e5184a5d92&scope.project.id=892d647615f4492b88dc72f4b3d3d17a&role.id=440a5fbd07d0485ba8c5215d283387c5 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:35.373915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 227/452] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:35.380309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:35.487361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d201-8a6e-4e43-a577-b26e9b9ee51e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:35.523475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:35.530475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.531144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.531424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.531694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] PATH_INFO: `/v3/projects/4f231d500254452db95956e5ca509c67` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.532829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] RBAC: Authorizing `identity:get_project(project_id=4f231d500254452db95956e5ca509c67)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.534319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.535976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 226/453] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:23:35 2022] GET /identity/v3/projects/4f231d500254452db95956e5ca509c67 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:35.541795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:35.624423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:35.644949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45df41-9ef7-4595-a9c6-82ff5b4fcba5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:35.680897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05317a-66cd-4751-a269-d5a73789b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.681573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05317a-66cd-4751-a269-d5a73789b080 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.681865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05317a-66cd-4751-a269-d5a73789b080 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.682132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05317a-66cd-4751-a269-d5a73789b080 None admin] PATH_INFO: `/v3/groups/ab19bb7fb57f4958a19de4250022c8d7` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.683279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05317a-66cd-4751-a269-d5a73789b080 None admin] RBAC: Authorizing `identity:get_group(group_id=ab19bb7fb57f4958a19de4250022c8d7)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.684707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05317a-66cd-4751-a269-d5a73789b080 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.686345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 228/454] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Aug 30 00:23:35 2022] GET /identity/v3/groups/ab19bb7fb57f4958a19de4250022c8d7 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:35.692506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:35.794112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd49f05-1b64-4415-8e89-edd1c527b993 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:35.827856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a476c-8212-49ec-95fa-0f212889b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:35.828466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a476c-8212-49ec-95fa-0f212889b069 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:35.828741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a476c-8212-49ec-95fa-0f212889b069 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:35.829036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a476c-8212-49ec-95fa-0f212889b069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:35.829810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a476c-8212-49ec-95fa-0f212889b069 None admin] RBAC: Adding query filter params (group.id=ab19bb7fb57f4958a19de4250022c8d7, role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=4f231d500254452db95956e5ca509c67) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:35.830116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a476c-8212-49ec-95fa-0f212889b069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:35.831532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a476c-8212-49ec-95fa-0f212889b069 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:35.837498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 227/455] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Aug 30 00:23:35 2022] GET /identity/v3/role_assignments?group.id=ab19bb7fb57f4958a19de4250022c8d7&scope.project.id=4f231d500254452db95956e5ca509c67&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:38.267389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d66ef-ae76-4fe7-8d2f-6430cf362fb4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.267958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d66ef-ae76-4fe7-8d2f-6430cf362fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.267958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d66ef-ae76-4fe7-8d2f-6430cf362fb4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.269665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 229/456] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:38.275307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b337-174a-4167-b0cb-fe1b74228812 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.275733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b337-174a-4167-b0cb-fe1b74228812 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.275884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b337-174a-4167-b0cb-fe1b74228812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.299290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9a86b337-174a-4167-b0cb-fe1b74228812 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:38.300771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9a86b337-174a-4167-b0cb-fe1b74228812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:38.336559 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49462-b487-4e54-a2f8-e0dbb62ac60f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.337175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49462-b487-4e54-a2f8-e0dbb62ac60f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.337745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49462-b487-4e54-a2f8-e0dbb62ac60f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.339571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 230/457] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:38.344928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07697c4c-32f8-4f22-9f34-030e7f5c0b86 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.345486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07697c4c-32f8-4f22-9f34-030e7f5c0b86 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.345996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07697c4c-32f8-4f22-9f34-030e7f5c0b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.371627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-07697c4c-32f8-4f22-9f34-030e7f5c0b86 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:38.374541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07697c4c-32f8-4f22-9f34-030e7f5c0b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:38.405907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:38.414253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 228/458] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:38.480274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 231/459] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:38.724536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329586b-a001-4f26-866d-3e9cc294f4df None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.725231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329586b-a001-4f26-866d-3e9cc294f4df None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.725746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329586b-a001-4f26-866d-3e9cc294f4df None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.727567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 229/460] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:38.733177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603774fd-f34a-45c5-b3f0-bd6d83193639 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.733531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603774fd-f34a-45c5-b3f0-bd6d83193639 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.733834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603774fd-f34a-45c5-b3f0-bd6d83193639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.755135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329586b-a001-4f26-866d-3e9cc294f4df None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:38.766298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-603774fd-f34a-45c5-b3f0-bd6d83193639 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:38.767516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-603774fd-f34a-45c5-b3f0-bd6d83193639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:38.895529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 232/461] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:38.897086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb5e08-3ff7-4db7-9cab-24625d6aa24d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.897387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb5e08-3ff7-4db7-9cab-24625d6aa24d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.897679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb5e08-3ff7-4db7-9cab-24625d6aa24d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.899782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 233/462] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:38.905086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9b50-7e84-40b1-b874-b9b05215a56d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.905396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9b50-7e84-40b1-b874-b9b05215a56d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.905702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9b50-7e84-40b1-b874-b9b05215a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.921854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329586b-a001-4f26-866d-3e9cc294f4df None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:38.924710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ae5e9b50-7e84-40b1-b874-b9b05215a56d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:38.925899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ae5e9b50-7e84-40b1-b874-b9b05215a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:38.928074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:38.965195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:38.965861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:38.966139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:38.966407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:38.982469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:38.983956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:39.003770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:39.004744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:39.005599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:39.005599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.005599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:39.005599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 230/463] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:39.009565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 234/464] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:39.009776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.014564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9b50-7e84-40b1-b874-b9b05215a56d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.079985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:39.158391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863584d-34b7-4d8e-a876-55b3df682ee7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.197815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.198449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.198732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.198991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.203578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9b50-7e84-40b1-b874-b9b05215a56d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.212744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.214248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:39.233990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:39.235014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:39.235844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:39.235844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.235844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:39.235844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 231/465] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:39.236501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.249822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.250747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.251298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.251800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.252729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:39.253279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.255458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.263726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:39.270532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 235/466] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:39.272207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.355088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:39.363937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14ded7-9716-4bf6-8642-78f34ecd70b4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.394161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98a200-5674-4f6a-adf4-674a9fc39122 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.405751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.406489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.406838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.407175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.418146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.419848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.432226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.432836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.433117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.433390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.434083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:39.434388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:39.435032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:39.435883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:39.436744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:39.436744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.436744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:39.436918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.441322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 232/467] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:39.442197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.448842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 236/468] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:39.450485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.515895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:39.548719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670af2b9-342c-487e-9b1c-bba7e8c05a22 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.564653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1538e-9c20-4ac0-aeb2-09ca5bc281c9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.584335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.584952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.585232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.585507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.586412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.587729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.602933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.603666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.604011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.604249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.612458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 233/469] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:39 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:39.613285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.616802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:39.622906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.624845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:39.643017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:39.644200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:39.645699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:39.645699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:39.645699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:39.645699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 237/470] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:39.645699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fed11-b012-4039-b0a4-4b4802f227f9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.767874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad028f-fb29-486a-a6f2-23aa5964d014 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:39.779889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:39.786240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513efd14-d398-44be-9209-04f21a3f0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.786869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513efd14-d398-44be-9209-04f21a3f0c3a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.787148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513efd14-d398-44be-9209-04f21a3f0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.787417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513efd14-d398-44be-9209-04f21a3f0c3a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.788097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513efd14-d398-44be-9209-04f21a3f0c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:39.788398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513efd14-d398-44be-9209-04f21a3f0c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.789821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513efd14-d398-44be-9209-04f21a3f0c3a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.803562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 234/471] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:39.804850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89977-ca67-4669-b3c8-9fe340e707de None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.805118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89977-ca67-4669-b3c8-9fe340e707de None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.806390 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89977-ca67-4669-b3c8-9fe340e707de None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.806917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 235/472] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:39.807446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7947248-b15c-4738-bb17-b576eda6bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:39.807649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89977-ca67-4669-b3c8-9fe340e707de None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.808164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947248-b15c-4738-bb17-b576eda6bc78 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.808458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947248-b15c-4738-bb17-b576eda6bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.808712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947248-b15c-4738-bb17-b576eda6bc78 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.809361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7947248-b15c-4738-bb17-b576eda6bc78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:39.812578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7947248-b15c-4738-bb17-b576eda6bc78 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:39.840394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 238/473] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:39 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:39.841724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce0870-963e-486a-b2bd-01e092dfb14c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:39.841971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce0870-963e-486a-b2bd-01e092dfb14c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:39.842300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce0870-963e-486a-b2bd-01e092dfb14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:39.862785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-efce0870-963e-486a-b2bd-01e092dfb14c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:39.864048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-efce0870-963e-486a-b2bd-01e092dfb14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:39.897770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:39.948755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 239/474] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:39.950029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce0870-963e-486a-b2bd-01e092dfb14c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:39.955204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89977-ca67-4669-b3c8-9fe340e707de None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:40.003975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:40.005280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:40.006334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:40.007104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:40.008027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:40.008775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:40.010967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:40.028569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 236/475] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:40.036408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:40.079470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:40.088985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce0870-963e-486a-b2bd-01e092dfb14c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:40.126126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:40.126742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:40.127019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:40.127378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:40.128100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:40.130857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:40.159507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 240/476] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:39 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:40.182039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe3014-e9e5-4a59-978f-5314ff6a3446 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:40.210812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:40.227352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:40.227980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:40.228258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:40.228534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:40.229189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:40.230684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:40.258483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 237/477] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:40 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:23:40.298858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:40.421972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc09258-ce16-4b33-afc7-bd8ddae141bb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:40.460045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:40.460675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:40.460963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:40.461287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:40.462015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:40.463404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:40.472678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.sql.core [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:23:40.472678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:23:40.472678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [parameters: {'id': 'ca8ee375445c48fa9e0d617ebcfa9fae', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:23:40.472678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Aug 30 00:23:40.489099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:23:40.490089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application yield resource Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise self.value Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application session.commit() Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:23:40.491186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:23:40.492070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:23:40.492943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:23:40.494536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [parameters: {'id': 'ca8ee375445c48fa9e0d617ebcfa9fae', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:40.495989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:23:40.497410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:40.499479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 241/478] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 30 00:23:40 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:40.501046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:40.608658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c52d22-d7ce-4136-acfc-be9ba2717b06 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:40.649166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c36885-abf0-477d-82be-2549f42789cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:40.649857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36885-abf0-477d-82be-2549f42789cb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:40.650135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36885-abf0-477d-82be-2549f42789cb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:40.650410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36885-abf0-477d-82be-2549f42789cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:40.661370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c36885-abf0-477d-82be-2549f42789cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f7c36885-abf0-477d-82be-2549f42789cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:40.666843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:40.667718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:40.668644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 238/479] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:23:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:40.673974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:40.697207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:40.794103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2673f-86a7-4c9d-8405-87b54bbde29a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:40.829817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5b295-da65-4181-b21a-046d51d74b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:40.830534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b295-da65-4181-b21a-046d51d74b69 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:40.830881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b295-da65-4181-b21a-046d51d74b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:40.831222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5b295-da65-4181-b21a-046d51d74b69 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:40.831961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5b295-da65-4181-b21a-046d51d74b69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:40.832334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5b295-da65-4181-b21a-046d51d74b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:40.833810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5b295-da65-4181-b21a-046d51d74b69 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:40.842343 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 242/480] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:41.831641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdaabc-5b77-4481-95d0-288ea967a6e9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:41.832179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdaabc-5b77-4481-95d0-288ea967a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:41.832179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdaabc-5b77-4481-95d0-288ea967a6e9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:41.833817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 239/481] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:41.839028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1f100-b245-41ef-9610-f7affe36269b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:41.839504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1f100-b245-41ef-9610-f7affe36269b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:41.839578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1f100-b245-41ef-9610-f7affe36269b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:41.861968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d7d1f100-b245-41ef-9610-f7affe36269b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:41.863179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d7d1f100-b245-41ef-9610-f7affe36269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:41.963334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 243/482] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:42.362167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f959e-f618-4ba5-8d8c-dacb7078a8c2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.362167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f959e-f618-4ba5-8d8c-dacb7078a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.362167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f959e-f618-4ba5-8d8c-dacb7078a8c2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:42.362930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 240/483] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:42.368478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9216-c117-478a-b97b-67b851a8a83d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.368768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9216-c117-478a-b97b-67b851a8a83d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.369042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9216-c117-478a-b97b-67b851a8a83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:42.394929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-82ee9216-c117-478a-b97b-67b851a8a83d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:42.396135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-82ee9216-c117-478a-b97b-67b851a8a83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:42.398379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:42.415684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f959e-f618-4ba5-8d8c-dacb7078a8c2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:42.477670 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 244/484] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:42.520716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:42.608627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f959e-f618-4ba5-8d8c-dacb7078a8c2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:42.659336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c312a-f603-4cbb-a014-95f3f660f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:42.659971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c312a-f603-4cbb-a014-95f3f660f705 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.660249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c312a-f603-4cbb-a014-95f3f660f705 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.660514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c312a-f603-4cbb-a014-95f3f660f705 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:42.675830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c312a-f603-4cbb-a014-95f3f660f705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-170c312a-f603-4cbb-a014-95f3f660f705 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:42.681057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:42.681920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:42.682706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 241/485] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:42.688257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee9216-c117-478a-b97b-67b851a8a83d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:42.711400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af1cb-a982-4f5d-9b22-b8ee2f46388c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.711733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af1cb-a982-4f5d-9b22-b8ee2f46388c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.711940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af1cb-a982-4f5d-9b22-b8ee2f46388c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:42.713419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 242/486] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:42.718181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfba08c-dc05-4adb-b079-dfaec35be881 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.718461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfba08c-dc05-4adb-b079-dfaec35be881 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.718733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfba08c-dc05-4adb-b079-dfaec35be881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:42.747929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-adfba08c-dc05-4adb-b079-dfaec35be881 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:42.749170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-adfba08c-dc05-4adb-b079-dfaec35be881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:42.851459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 243/487] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:42.852208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee9216-c117-478a-b97b-67b851a8a83d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:42.852627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfba08c-dc05-4adb-b079-dfaec35be881 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:42.904369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:42.913731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2baf37-18f6-432e-9d45-530fd1203dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:42.914598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2baf37-18f6-432e-9d45-530fd1203dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.915050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2baf37-18f6-432e-9d45-530fd1203dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.915493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2baf37-18f6-432e-9d45-530fd1203dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:42.916347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2baf37-18f6-432e-9d45-530fd1203dc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:42.916822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2baf37-18f6-432e-9d45-530fd1203dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:42.918416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2baf37-18f6-432e-9d45-530fd1203dc5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:42.924675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:42.933589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 245/488] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:42.935226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e03966-01a2-4004-a4f6-cee5be303525 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.935510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e03966-01a2-4004-a4f6-cee5be303525 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.935783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e03966-01a2-4004-a4f6-cee5be303525 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:42.938414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 246/489] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:42.938414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e03966-01a2-4004-a4f6-cee5be303525 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.010407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfba08c-dc05-4adb-b079-dfaec35be881 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.047692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb229-5bea-49b4-85b5-cbdcde983e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.048337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb229-5bea-49b4-85b5-cbdcde983e9a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.048617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb229-5bea-49b4-85b5-cbdcde983e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.048878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb229-5bea-49b4-85b5-cbdcde983e9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.059749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e03966-01a2-4004-a4f6-cee5be303525 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.059894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeb229-5bea-49b4-85b5-cbdcde983e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0beeb229-5bea-49b4-85b5-cbdcde983e9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:43.065087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:43.066093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 244/490] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:43.072137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c756e-46bd-4cc1-add8-d5957fef2db4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.072903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c756e-46bd-4cc1-add8-d5957fef2db4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.072903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c756e-46bd-4cc1-add8-d5957fef2db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.087622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2d3c756e-46bd-4cc1-add8-d5957fef2db4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:43.088921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2d3c756e-46bd-4cc1-add8-d5957fef2db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:43.106661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.107631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.108106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.108628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.120197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.122000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:43.138007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:43.138988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:43.139978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:43.139978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:43.139978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:43.141852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 247/491] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:43.143051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.161892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 245/492] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:43.162747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c756e-46bd-4cc1-add8-d5957fef2db4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.186355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.209010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.258778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354156a4-64df-4f71-9cff-cb583943b715 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.282938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c756e-46bd-4cc1-add8-d5957fef2db4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.294500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.295104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.295387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.295662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.296491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:43.296800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.298245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.307252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:43.308151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.323164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.324264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.324800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.325258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.326140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:43.326650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.328531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.340988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 246/494] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:43.342056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.416940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e666a8-5e05-4b70-b8f7-a718cfe36d55 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.431440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.439504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.453317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.453910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.454192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.454464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.460120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617eade-677b-4033-bdb4-66bd740805af None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.468874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:43.475655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:43.476643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:43.477454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 249/495] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:43.478194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.504065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.505105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.505387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.505675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.516695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.518187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:43.532973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:43.534115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:43.535107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:43.535107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:43.535107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:43.536532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 247/496] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:43.537505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.591266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d0517-9efe-4d76-87e9-fb207229f4d6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.623961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.624608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.624883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.625154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.632882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.634385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.644953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90661f-7646-4a36-b15b-758819dae5f5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:43.647244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:43.648153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:43.649005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:43.649610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.678560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.684479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.684982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.685951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.686189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.686562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.697111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:43.702354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:43.703220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:43.703989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:43.705652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.756303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b0979-1e39-4bb7-bbc3-4bc93c2da876 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.792377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf031a-e8a9-4428-b5fe-dd1e08c46a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.792994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf031a-e8a9-4428-b5fe-dd1e08c46a7e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.793278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf031a-e8a9-4428-b5fe-dd1e08c46a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.793647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf031a-e8a9-4428-b5fe-dd1e08c46a7e None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.794311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf031a-e8a9-4428-b5fe-dd1e08c46a7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:43.794630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf031a-e8a9-4428-b5fe-dd1e08c46a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.796090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf031a-e8a9-4428-b5fe-dd1e08c46a7e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.804503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:43.805911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d053a5-37a8-4213-be23-0fef53b1e899 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.806181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d053a5-37a8-4213-be23-0fef53b1e899 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.806446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d053a5-37a8-4213-be23-0fef53b1e899 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.807623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 252/500] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:43.810325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d053a5-37a8-4213-be23-0fef53b1e899 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.810967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0dcc7-f44e-4c4e-9f9a-b2a46baf590d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.846044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.846650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.846928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.847195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.847835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:43.848133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.849670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.862570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 249/501] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:43.863298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.909030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.915483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:43.918403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d053a5-37a8-4213-be23-0fef53b1e899 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.952949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.953623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.953902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.954169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.955050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:43.955365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.956832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.963890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a7065-c335-46b5-a77f-ef347334665a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.993761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 253/502] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:43.994642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.997412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a18ff4-e38a-4ecf-93b4-af9b4223fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.998041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18ff4-e38a-4ecf-93b4-af9b4223fc81 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.998315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18ff4-e38a-4ecf-93b4-af9b4223fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.998852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18ff4-e38a-4ecf-93b4-af9b4223fc81 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.999537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a18ff4-e38a-4ecf-93b4-af9b4223fc81 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:43.999832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a18ff4-e38a-4ecf-93b4-af9b4223fc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.001194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a18ff4-e38a-4ecf-93b4-af9b4223fc81 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.010047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 250/503] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:44.011283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323fe98-46e3-4d68-8f0b-ad07849b3c5c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.011568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323fe98-46e3-4d68-8f0b-ad07849b3c5c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.011843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323fe98-46e3-4d68-8f0b-ad07849b3c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.029854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6323fe98-46e3-4d68-8f0b-ad07849b3c5c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:44.031064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6323fe98-46e3-4d68-8f0b-ad07849b3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:44.099863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 251/504] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:44.100791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323fe98-46e3-4d68-8f0b-ad07849b3c5c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.109687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117fb15-c33b-4f40-bbd9-41b7a596faa8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.146490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.147151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.147428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.147696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.149052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.158563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.160029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:44.177787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:44.178913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:44.179957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:44.179957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.179957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:44.183854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 254/505] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:44.184556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.194049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.210240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323fe98-46e3-4d68-8f0b-ad07849b3c5c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.248047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.249262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.249898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.250256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.258922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.260483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:44.273336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:44.274388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 252/506] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:44.275287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.294529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bbb48-cb43-490f-b272-a49826e62141 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.335131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.335736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.336011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.336279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.384617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d661-67c4-4596-8330-535ba69e233c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.388551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.406468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.407941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.415483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.419775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.420413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.420713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.420986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.432734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.434232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:44.449929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:44.451045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:44.457377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:44.457377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.457377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:44.457377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 253/507] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:44.457377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.506863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 255/508] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:44.507749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.551362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f7f5e-9ca6-42de-8baf-5e52d7cd0077 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.585239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.585912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.586237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.586475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.587117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:44.587421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.588840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.600853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 254/509] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:44.601653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.612636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337a28-f8e3-415f-83ba-05c18fb22cee None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.620173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.621296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.651527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.652147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.652428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.652687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.653451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:44.653782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.655268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.672853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 256/510] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:44.673746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.706395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6ac7-c246-41fb-876d-890ec0783225 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.739392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.740035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.740304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.740574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.750903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.752401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:44.767373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:44.768440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:44.769360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:44.769360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.769360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:44.769360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 255/511] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:44.769360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.773914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97eb0c-fb9f-4a66-81ac-aed1f4c21cc6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.809458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.810254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.810532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.810805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.811451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:44.811756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.813160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.824629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 257/512] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:44.825424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.836183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.851773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:44.871378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d415fd9-734a-45cd-9625-10c27d1a06d2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.905529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.906207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.906482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.906751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.917178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.918705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.926792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4973ba-1a67-4fd4-b16f-2822d23304d2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:44.932591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:44.933729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:44.934771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:44.934771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:44.934771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:44.934771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:44.936095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:44.963001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:44.963642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:44.963919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:44.964187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:44.971761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:44.973229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:44.985265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:44.986372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 258/514] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:44.987669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.055665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35a88-d57b-4ca1-b077-bd2550777cdc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.075373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.077467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.090106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.090780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.091062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.091329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.094726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3371044-c612-4d27-b5fb-e294a8e727a6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.127963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.128969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.129256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.129568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.130223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:45.130550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.131963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.144613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 259/515] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:45.145338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.159990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.161583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.252168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc53f20-8b88-48d5-86e8-c4cd27326f47 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.262267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 257/516] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:45.263182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.285949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.286888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.287516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.287786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.288075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.295468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.296955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:45.308692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:45.309786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:45.310997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 260/517] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:45.312686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.316258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.368066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24b15-a739-4d3f-b2b5-2276d1244ed9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.403864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.404476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.404753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.405018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.405755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:45.406046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.407463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.417074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337c90-b30a-4920-aefc-d5c1ea2aa773 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.419229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 258/518] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:45.420060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.453039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.453660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.453935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.454201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.454924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:45.455219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.456679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.474154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 261/519] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:45.474988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.503270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.522922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bc062-a536-438a-bf9c-81da07edbeb0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.535901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.556259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.556920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.557200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.557473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.558143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.559635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.582624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc148bd1-dabf-4852-9b58-df22cb0bff35 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.583720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 259/520] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:23:45 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:45.584562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.623435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.624136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.624412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.624687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.636852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.638510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:45.654779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:45.655972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:45.656834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:45.656834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:45.656834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:45.656834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 262/521] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:45.657185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.723533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4166-2ebf-4661-a80a-9972c017972e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.766369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.766596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.767547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.767547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.768391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:45.768391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.771203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.779774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667797bc-8646-478c-8e0d-0d1f9ff6c7bc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.788013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.795615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:45.816355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 260/522] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:45.817217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.823500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.824225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.824578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.824922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.832384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:45.833954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:45.846968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:45.848047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:45.849459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:45.850241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 263/523] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:45.850899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:45.926446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3a557-6144-4004-8a46-b7d50d4ebd6a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.957772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0b21-4680-4b30-8d55-03c9e5539fcd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:45.963024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.963794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.964138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.964475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:45.998058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:45.998758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:45.999159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:45.999494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.000308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:46.000758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.002187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.015936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 264/524] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:46.016835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.035245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.044138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.045771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.052248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.120630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bff8d-a4a8-446a-a2c6-5cf2dcb7bdce None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.151916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 261/525] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:46.155847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.156778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.157062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.157333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.157470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.230781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.232388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.256024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.264169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c734fc-cf6f-4d9d-a96d-01ba13ad9724 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.269355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.303586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.304362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.304736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.305166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.305918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:46.306732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.308191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.326301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 262/526] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:46.327519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.348249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 265/527] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:46.349132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.443389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2911-c340-4555-a569-cbab2e6298db None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.462114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dc3f1-6e14-4ec8-a0a6-f038aa557c2e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.479693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.480424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.480701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.480971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.488248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.489752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.498066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.498985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.499427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.499909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:46.501651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:46.502648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 263/528] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:46.503938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.508974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.519234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.520786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.525826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:46.537011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:46.538242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:46.539112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:46.539112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:46.539112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:46.539112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 266/529] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:46.539112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.622958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76528cf3-3693-439c-a954-1209721acbdb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.652673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2e51-d7f2-46f5-a80f-d8e267a62c60 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.659154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.659914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.660193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.660463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.661198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=aa4e1f12814a4923a2a37d771c59d40c) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:46.661649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.663218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.677060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 264/530] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/role_assignments?user.id=aa4e1f12814a4923a2a37d771c59d40c&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:46.677060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.701057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.702315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.702598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.702923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.717471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.719328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:46.739873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:46.741014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:46.742008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:46.742008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:46.742008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:46.742788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 267/531] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:46.743896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.784172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.803150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:46.819644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4be314-43c0-42ef-8bd0-68dfef327db9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.856279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.856885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.857168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.857438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.858201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:46.858509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.859940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.872514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ae46-f321-4293-afc7-c13f53196c4d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:46.872779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 265/532] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:46.873829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.915430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:46.916380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:46.917064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:46.917336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:46.918381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:46.918701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:46.920438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:46.937629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 268/533] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:46.938472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:46.984460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a6022-d388-49f0-b85c-f04b8eab63dc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.025733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.026452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.026730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.026999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.027652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:47.027951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.029322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.036602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:47.044131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 266/534] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:47.048863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:47.068467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:47.079397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5749ce5-cc7e-44a9-aebd-1a2f557a1df3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.126524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.127420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.127844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.128249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.129690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=4d3160eee18a4f7cb9f6880ec1b672a1) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:47.130671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.132497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.140810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 269/535] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:46 2022] GET /identity/v3/role_assignments?user.id=4d3160eee18a4f7cb9f6880ec1b672a1&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:47.142293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:47.169350 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c98a94-b5c4-4cbb-9cf0-dece1e477593 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.209014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.210047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.210517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.210969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.218853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.220721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:47.234153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:47.235057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:47.236232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 267/536] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:47.241376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:47.309750 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151980f-5072-408a-bbdb-7e17415ec8ec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.359042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:47.381272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.382036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.382379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.382715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.403149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.404629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:47.425479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:47.426400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:47.427320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 270/537] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:47.435705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:47.444192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3db7c-7b21-4f09-bed3-12104a3766a5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.493899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:47.514854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.515465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.515736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.515999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.516691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:47.516985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.518454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.543992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 268/538] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:47.550283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:47.617731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ea7b-beb9-4d18-8826-d4f27972fdc5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.656204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91232a-a0b2-4037-a5d6-f34a497c7b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.656809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91232a-a0b2-4037-a5d6-f34a497c7b33 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.657082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91232a-a0b2-4037-a5d6-f34a497c7b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.657347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91232a-a0b2-4037-a5d6-f34a497c7b33 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.658235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91232a-a0b2-4037-a5d6-f34a497c7b33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:47.658623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91232a-a0b2-4037-a5d6-f34a497c7b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.660050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91232a-a0b2-4037-a5d6-f34a497c7b33 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.673561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f4bd-1870-4b56-9382-4915b1279fd9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.679487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 271/539] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:47.680790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da212f-4baa-4895-aa44-21365a1cc2d3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.681074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da212f-4baa-4895-aa44-21365a1cc2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.681345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da212f-4baa-4895-aa44-21365a1cc2d3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.682900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 272/540] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:47.687806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da212f-4baa-4895-aa44-21365a1cc2d3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:47.692712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:47.711382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f79ff7-6fad-493c-b163-7998b2c11d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.711988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79ff7-6fad-493c-b163-7998b2c11d61 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.712263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79ff7-6fad-493c-b163-7998b2c11d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.712644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f79ff7-6fad-493c-b163-7998b2c11d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.713386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f79ff7-6fad-493c-b163-7998b2c11d61 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=5301330fc789466ab0c1c4aae41b6330) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:47.713733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f79ff7-6fad-493c-b163-7998b2c11d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.715250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f79ff7-6fad-493c-b163-7998b2c11d61 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.720977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 269/541] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:47 2022] GET /identity/v3/role_assignments?user.id=5301330fc789466ab0c1c4aae41b6330&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:47.726612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a875b-3bbd-4ae7-8d02-cf1c31bac511 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.726797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a875b-3bbd-4ae7-8d02-cf1c31bac511 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.726960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a875b-3bbd-4ae7-8d02-cf1c31bac511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.764116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1b5a875b-3bbd-4ae7-8d02-cf1c31bac511 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:47.765394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1b5a875b-3bbd-4ae7-8d02-cf1c31bac511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:47.788612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:47.811868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da212f-4baa-4895-aa44-21365a1cc2d3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:47.855439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:47.856621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:47.857886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:47.858561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:47.860502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=77470d4430f04d30b64297de78e67f56) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:47.861121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:47.863691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:47.877129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 273/542] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:47 2022] GET /identity/v3/role_assignments?user.id=77470d4430f04d30b64297de78e67f56&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:47.892503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 270/543] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:48.225720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:48.332700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c24e2-eeeb-4743-b0a5-a8c725fb4b64 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:48.368489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:48.369365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:48.369815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:48.370222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:48.381840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:48.387580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:48.388633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:48.389667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:48.391797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 274/544] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:48.397735 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a875b-3bbd-4ae7-8d02-cf1c31bac511 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:48.537001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a875b-3bbd-4ae7-8d02-cf1c31bac511 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:48.554550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:48.583025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:48.583638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:48.583913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:48.584180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:48.584844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:48.585145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:48.586551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:48.599782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 271/545] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:48.605380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:48.614607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:48.709129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15458f0-82b5-4886-9ca6-b191e2b0ecb5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:48.743894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5b8f1-618a-4c80-ba24-f6ab4ac99bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:48.744528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b8f1-618a-4c80-ba24-f6ab4ac99bee None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:48.744806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b8f1-618a-4c80-ba24-f6ab4ac99bee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:48.745077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b8f1-618a-4c80-ba24-f6ab4ac99bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:48.756603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5b8f1-618a-4c80-ba24-f6ab4ac99bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:48.758114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5b8f1-618a-4c80-ba24-f6ab4ac99bee None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b1b5b8f1-618a-4c80-ba24-f6ab4ac99bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:48.772561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:48.773455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:48.774330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:48.774330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:48.774330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:48.774330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 275/546] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:48.780759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:48.863689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc643-9d0b-4d2b-8ff0-a20a1774ad72 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:48.864001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc643-9d0b-4d2b-8ff0-a20a1774ad72 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:48.864176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc643-9d0b-4d2b-8ff0-a20a1774ad72 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:48.865717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 276/547] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:48.871901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434fd1-cb83-4f98-ba38-a6241d619427 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:48.872251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434fd1-cb83-4f98-ba38-a6241d619427 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:48.872442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434fd1-cb83-4f98-ba38-a6241d619427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:48.892891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ed434fd1-cb83-4f98-ba38-a6241d619427 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:48.894234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ed434fd1-cb83-4f98-ba38-a6241d619427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:48.909424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c574d-91d2-4fac-bbae-73efff0ddd93 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:48.959499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:48.976610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 277/548] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:48.987168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:48.987804 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:48.988080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:48.988349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:48.989012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:48.989311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:48.990730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:49.003794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 272/549] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:49.009652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434fd1-cb83-4f98-ba38-a6241d619427 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:49.154321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434fd1-cb83-4f98-ba38-a6241d619427 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:49.189866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956ef97-a2c8-4717-9d94-cf4b369fd35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:49.190548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ef97-a2c8-4717-9d94-cf4b369fd35f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.190832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ef97-a2c8-4717-9d94-cf4b369fd35f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.191103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956ef97-a2c8-4717-9d94-cf4b369fd35f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.198646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956ef97-a2c8-4717-9d94-cf4b369fd35f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:49.200105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956ef97-a2c8-4717-9d94-cf4b369fd35f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d956ef97-a2c8-4717-9d94-cf4b369fd35f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:49.212086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:49.213572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:49.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 278/550] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:49.219287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:49.261944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:49.323725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c869ea-e01e-481e-807e-f6a7b7c97e78 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:49.335453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce53f3-2256-4020-9c37-c6494ce4e3df None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.336042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce53f3-2256-4020-9c37-c6494ce4e3df None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.336188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce53f3-2256-4020-9c37-c6494ce4e3df None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.337564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 279/551] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:23:49.342665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae575-e02e-4e6c-b75f-a7298d782643 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.342949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae575-e02e-4e6c-b75f-a7298d782643 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.343223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae575-e02e-4e6c-b75f-a7298d782643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.364809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:49.365630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.366006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.366373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.367366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:49.367772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:49.369352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:49.375079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d10ae575-e02e-4e6c-b75f-a7298d782643 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:49.379599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d10ae575-e02e-4e6c-b75f-a7298d782643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:49.392643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 273/552] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 30 00:23:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:49.398672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:49.494534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:49.498140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:49.510040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e762d-541d-4ab4-86f0-5ac2e55b716d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:49.520597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 280/553] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:49.521638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae575-e02e-4e6c-b75f-a7298d782643 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:49.561388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:49.562043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.562320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.562591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.634985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae575-e02e-4e6c-b75f-a7298d782643 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:49.674086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:49.675021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.675402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.675773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.687676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:49.693145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:49.694375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:49.695415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:49.701828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 281/554] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:49.703855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:49.726631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:49.728320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:49.763004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:49.853038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 274/555] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:49.853429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:49.858412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:49.940139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef171442-3334-4a18-8bc4-09f0df8a8737 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:49.974631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01347e67-f545-4c39-8be3-f3252db192e7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:49.975151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:49.975756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.976031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.976320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.976978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:49.977875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:49.978701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:49.987224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 282/556] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:49.987826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.015563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d0d15-c47b-4d0e-b735-8a9751f4a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.016112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0d15-c47b-4d0e-b735-8a9751f4a0fe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.016388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0d15-c47b-4d0e-b735-8a9751f4a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.016646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0d15-c47b-4d0e-b735-8a9751f4a0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.028518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d0d15-c47b-4d0e-b735-8a9751f4a0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.030176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d0d15-c47b-4d0e-b735-8a9751f4a0fe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6e0d0d15-c47b-4d0e-b735-8a9751f4a0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:50.046101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:50.047030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:50.047860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:50.047860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:50.047860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:50.052013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 275/557] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:50.053262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdffee-9b69-4a6e-85ce-c7abbc6cbd30 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.053561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdffee-9b69-4a6e-85ce-c7abbc6cbd30 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.053825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdffee-9b69-4a6e-85ce-c7abbc6cbd30 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.055070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 276/558] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:50.055760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdffee-9b69-4a6e-85ce-c7abbc6cbd30 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.093661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.096682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c7913-1748-40e1-a526-85c7cb77c4b2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.110026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.134994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.135695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.135975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.136247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.146727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:50.152480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:50.153896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 283/559] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:50.154709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.173593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdffee-9b69-4a6e-85ce-c7abbc6cbd30 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.208506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0602e3-ee73-411b-b2df-f6ee869c7142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.209139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0602e3-ee73-411b-b2df-f6ee869c7142 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.209415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0602e3-ee73-411b-b2df-f6ee869c7142 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.209733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0602e3-ee73-411b-b2df-f6ee869c7142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.220675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0602e3-ee73-411b-b2df-f6ee869c7142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.222252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0602e3-ee73-411b-b2df-f6ee869c7142 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ed0602e3-ee73-411b-b2df-f6ee869c7142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:50.237069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:50.238192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:50.239058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:50.239058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:50.239058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:50.239058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 277/560] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:50.239784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30a7a-495a-4139-86f9-267ea36a71ae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.239784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30a7a-495a-4139-86f9-267ea36a71ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.239948 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce30a7a-495a-4139-86f9-267ea36a71ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.258249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bce30a7a-495a-4139-86f9-267ea36a71ae None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:50.259439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bce30a7a-495a-4139-86f9-267ea36a71ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:50.272204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629e404-b318-459d-b3e7-dd78e901d36f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.307718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.308442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.308730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.309047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.309830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:50.310137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.311588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.324209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 284/561] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:50.325033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.336191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 278/562] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:50.337452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce30a7a-495a-4139-86f9-267ea36a71ae None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.353327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.368962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.444719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce30a7a-495a-4139-86f9-267ea36a71ae None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.449620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121122b-6e27-4bf3-bfa4-04c1051450b3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.480508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.481355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.481818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.482225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.483091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:50.483734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.485423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.486512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.487358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.487682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.488017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.489120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:50.489120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.490690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.499110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 279/563] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:50.501599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 285/564] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:50.504700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.504903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.592809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.596302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.612311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1e796-c369-475e-8faf-f730a0c8feba None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.612588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aae13-ecf5-44a1-b2b8-ede7728d3c9a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.644985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8b909-45f9-4856-abf8-d6853c3b2816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.645528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.645666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8b909-45f9-4856-abf8-d6853c3b2816 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.645898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8b909-45f9-4856-abf8-d6853c3b2816 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.646166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8b909-45f9-4856-abf8-d6853c3b2816 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.646256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.646445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.646715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.654044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.654954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8b909-45f9-4856-abf8-d6853c3b2816 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.655509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.656410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8b909-45f9-4856-abf8-d6853c3b2816 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:50.666833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:50.667797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:50.673579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-95f8b909-45f9-4856-abf8-d6853c3b2816 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:50.674018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:50.674943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:23:50.676111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:50.676734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 280/565] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:50.676819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 286/566] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:50.677023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.677123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c15d-0d44-4001-a146-55e694b03689 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.677123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c15d-0d44-4001-a146-55e694b03689 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.677123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c15d-0d44-4001-a146-55e694b03689 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.677123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 287/567] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:50.677123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c15d-0d44-4001-a146-55e694b03689 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.776014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5d83-2d51-417e-adb5-d81351c22e0f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.778196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c15d-0d44-4001-a146-55e694b03689 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.809514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.810176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.810454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.810719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.810925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.811548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.811818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.812078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.821186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.822107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:50.822670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:50.827379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:50.828302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:50.829152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 288/568] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:50.830540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.830621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.833218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:50.840143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:50.841113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:50.841993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:50.841993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:50.841993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:50.841993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 281/569] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:50.842230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.932147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5a4c8-c2de-4a98-bd97-1c26e99f1fee None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.938679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071d98-324b-4dfa-9cf1-13dd4719be77 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.966660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72950ba9-16ae-4a7f-9a6a-f871e121ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.967268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950ba9-16ae-4a7f-9a6a-f871e121ca99 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.967573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950ba9-16ae-4a7f-9a6a-f871e121ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.967844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950ba9-16ae-4a7f-9a6a-f871e121ca99 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.968534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950ba9-16ae-4a7f-9a6a-f871e121ca99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:50.968861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950ba9-16ae-4a7f-9a6a-f871e121ca99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.970331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950ba9-16ae-4a7f-9a6a-f871e121ca99 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.973576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.974174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.974447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.974710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.975441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:50.975739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.977623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.982077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 289/570] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:50.983328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e22bb-598a-488b-9e28-62010585fbb7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.983616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e22bb-598a-488b-9e28-62010585fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.983891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e22bb-598a-488b-9e28-62010585fbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.999452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 282/571] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.000294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.008877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-139e22bb-598a-488b-9e28-62010585fbb7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:51.010295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-139e22bb-598a-488b-9e28-62010585fbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:51.060220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.068226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.080569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 290/572] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:51.081285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e22bb-598a-488b-9e28-62010585fbb7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.109971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2744329-df24-46a6-a1c3-e03789529d53 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.149396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.150190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.150507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.150846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.151633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:51.151919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.153359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.167242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 283/573] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.168109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.195536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e22bb-598a-488b-9e28-62010585fbb7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.230387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.231411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.231692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.231963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.232601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:51.232899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.234333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.245407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 291/574] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.246243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.274223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0e04-e8f2-40d2-bdd4-762b110734a8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.291820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.305940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.312726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.313410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.313738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.314009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.314900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=5ba04cf2f81b4a33863e0789b706061e) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:51.315211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.316755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.333730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 284/575] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/role_assignments?user.id=5ba04cf2f81b4a33863e0789b706061e&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.333730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.371983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f2186-0bf8-4022-8d64-a84982019ce7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.415686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.416398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.416698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.416972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.429206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.430743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:51.446597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:51.447800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:51.448689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:51.448689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:51.448689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:51.452722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c593173-c139-4965-affb-11d23587ab47 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.453228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 292/576] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:51.453919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.490888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.491548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.491848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.492118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.504034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.505426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:51.520247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:51.521373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:51.522289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:51.522289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:51.522289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:51.522289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 285/577] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:51.522289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.557893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.569781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526addf-3fcb-4e4e-b2d5-1da425108bdd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.572499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.607986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.608845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.609121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.609402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.617169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.618659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:51.630709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:51.631664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 293/578] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:51.632609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.635824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4e6f-5134-409a-9d13-d7c642c46983 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.673441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.674109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.674385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.674655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.684989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:51.689830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:51.690778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:51.691666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:51.695958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 286/579] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:51.696867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.746681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a04f76-000d-4474-8946-1cfb27350597 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.788632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.789247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.789523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.789866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.790505 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:51.790838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.792206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.794035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.801801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36b05b-d470-4cd8-b3f6-417aee2f04e8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.810554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 294/580] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.810554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.836223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.846063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.847491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.847775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.848042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.848684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:51.849023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.850409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.863533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 287/581] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.864249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.927690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a36b73-b1d8-4018-8d3a-861fc562a375 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.964145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.964665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.964943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.965210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.965962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:51.966265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.967746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.970240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cfb4d-b11d-4bd0-8797-7107b8881608 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.985231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 295/582] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.986287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.010194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.011094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.011585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.012040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.012891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:52.013372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.014923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.027562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 288/583] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:52.028490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.046859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.074482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.095008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c7395-deeb-4b12-b6f5-e284a3130773 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.130334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.130961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.131248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.131512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.136350 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312fe23-a63c-459f-9a2b-5e86ab977b1d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.138078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.139587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:52.150724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:52.151645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:52.152771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 296/584] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:52.154695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.176457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.177185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.177461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.177722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.186071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.187559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:52.198723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:52.199679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 289/585] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:52.200653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.265703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94383536-df54-4913-8d45-443d3e68ba72 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.292407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.305015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.305681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.305786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2034-f60c-4e89-9b04-ddc0ad81fa73 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.305957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.306369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.318457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.320522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.322630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:52.338098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:52.339233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:52.340299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:52.340299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:52.340299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:52.342966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.343690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.344036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.344549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.344734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 297/586] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:52.345691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.355864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.357400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:52.372065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:52.373203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:52.379774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:52.379774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:52.379774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:52.379774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 290/587] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:52.379774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.464345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a6196-1856-4ee4-becd-a5dc22f56926 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.489793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571fa0-2984-40bc-afa6-666695009e10 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.499555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.500298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.500681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.501044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.501865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:52.502270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.504112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.517604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.520882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 298/588] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:52.521752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.527464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.528219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.528576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.528937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.529795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:52.530260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.531773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.549686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 291/589] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:52.550799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.594068 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.642385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd5534-8ab9-4fb3-bdd4-f3670bf9ef4d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.665752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afbce-36a6-4339-9ac2-0d3eeb1cf640 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.678908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.679516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.680127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.680236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.680861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:52.681367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.682766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.698661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 299/590] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:52.699576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.718978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.719849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.720118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.720382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.721150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:52.721449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.723134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.736740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 292/591] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:52.737788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.794234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.813998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c06e3c-2fc7-4f12-ac8e-89fce44a0c84 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.829491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:52.851435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.852091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.852260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ca3c9-60ac-41d2-87a3-a444dd26d1db None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:52.852390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.852616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/aa4e1f12814a4923a2a37d771c59d40c/roles/fd92aa943af04a3c8616b3cb3138ece2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.869132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=aa4e1f12814a4923a2a37d771c59d40c, role_id=fd92aa943af04a3c8616b3cb3138ece2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.870619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.885302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 300/592] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:52 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/aa4e1f12814a4923a2a37d771c59d40c/roles/fd92aa943af04a3c8616b3cb3138ece2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:52.886021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:52.910654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:52.911312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:52.911581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:52.911842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:52.931439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:52.933573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:52.957736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:52.958758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:52.959643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:52.959643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:52.959643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:52.963021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 293/593] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:52.964231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.010159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a629e-7313-4ac8-b785-14a02326692b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.050953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.051511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.051795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.052049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.060359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.061972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:53.077815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:53.078773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 301/594] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:53.080065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.104976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:53.111542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec97fb-1a40-4508-bc8b-7f21fb3ea4d1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.117382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:53.161868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.163567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.164021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.164431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.175922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.177867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:53.195115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:53.196277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:23:53.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:53.199671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 294/595] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:53.200684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.218056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c97ce-779b-4353-a2c4-48fc1a4ec31f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.259309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.259876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.260173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.260439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.261077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:53.261611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.262889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.275788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 302/596] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:53.276642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.326480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97c5a9-0a39-4cd5-8fa1-8007b4fa51cf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.362772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d16d6-ae6e-4fb6-9f13-9703758264a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.363373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d16d6-ae6e-4fb6-9f13-9703758264a1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.363648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d16d6-ae6e-4fb6-9f13-9703758264a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.363911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d16d6-ae6e-4fb6-9f13-9703758264a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.364604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d16d6-ae6e-4fb6-9f13-9703758264a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:53.364905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d16d6-ae6e-4fb6-9f13-9703758264a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.365605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:53.366563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d16d6-ae6e-4fb6-9f13-9703758264a1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.381090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 295/597] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:53.383708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847986-791c-4388-ad7e-a85d50bd921c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.383997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847986-791c-4388-ad7e-a85d50bd921c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.384278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847986-791c-4388-ad7e-a85d50bd921c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.386411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 296/598] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:53.389595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1847986-791c-4388-ad7e-a85d50bd921c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.395510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e0b83-df2a-4a4b-aba4-8c185d47a2b4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.408826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:53.432000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.432618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.433150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.433150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.433917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:53.434222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.435652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.454814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 303/599] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 30 00:23:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:53.456163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.497322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1847986-791c-4388-ad7e-a85d50bd921c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.534057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0a77-5b2d-4087-81e4-97cc9828e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.534694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0a77-5b2d-4087-81e4-97cc9828e8bb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.534973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0a77-5b2d-4087-81e4-97cc9828e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.535238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0a77-5b2d-4087-81e4-97cc9828e8bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.542155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0a77-5b2d-4087-81e4-97cc9828e8bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.543586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0a77-5b2d-4087-81e4-97cc9828e8bb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-742a0a77-5b2d-4087-81e4-97cc9828e8bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:53.555775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:53.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:53.557605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 297/600] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:53.558690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5711-2f92-49c3-a0ec-074a26b40c08 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.558690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5711-2f92-49c3-a0ec-074a26b40c08 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.558690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da5711-2f92-49c3-a0ec-074a26b40c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.571018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08c7f-f150-4f12-a394-998f18490eab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.577334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-02da5711-2f92-49c3-a0ec-074a26b40c08 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:53.578520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-02da5711-2f92-49c3-a0ec-074a26b40c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:53.612997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.613700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.613977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.614245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/4d3160eee18a4f7cb9f6880ec1b672a1/roles/fd92aa943af04a3c8616b3cb3138ece2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.630675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:53.634969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=4d3160eee18a4f7cb9f6880ec1b672a1, role_id=fd92aa943af04a3c8616b3cb3138ece2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.636838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.650581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 298/601] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:53.651514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5711-2f92-49c3-a0ec-074a26b40c08 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.663102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:53.663678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 304/602] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:53 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/4d3160eee18a4f7cb9f6880ec1b672a1/roles/fd92aa943af04a3c8616b3cb3138ece2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:53.665951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.845730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da5711-2f92-49c3-a0ec-074a26b40c08 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.864363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9e45-835c-45e5-a2a0-0ed2bb1f6e6c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:53.882889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.883987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.884528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.885052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.895871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.897569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.904054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:53.904751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:53.905151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:53.905492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:53.906401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:53.906789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:53.908584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:53.916141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:53.917127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:53.918066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:53.918066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:53.918066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:53.920192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 299/603] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:53.924914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 305/604] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:53.926310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.927787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:53.985803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:53.990897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:54.034830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4dcb-d604-41bb-a115-4420a1e5a9b6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.040161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de026c4d-cb8e-4ef7-8611-027fa8a31c42 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.072385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.073177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.073565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.074034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.075060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:54.075208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:54.077123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:54.080451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.081347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.081835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.082310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/5301330fc789466ab0c1c4aae41b6330/roles/fd92aa943af04a3c8616b3cb3138ece2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.093453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 300/605] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:54.098464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:54.101528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=5301330fc789466ab0c1c4aae41b6330, role_id=fd92aa943af04a3c8616b3cb3138ece2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:54.107601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:54.130508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 306/606] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:53 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/5301330fc789466ab0c1c4aae41b6330/roles/fd92aa943af04a3c8616b3cb3138ece2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:23:54.136812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:54.210395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517557d-5cc8-4b3b-82a5-8d8da7f5c69a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.233052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:54.263102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.263838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.264121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.264461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.284877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a983fff-adb2-4bfb-b22b-58b8eeaa9eeb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.294230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:54.299274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:54.300291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:54.301112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:54.301754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:54.305522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 301/607] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:54.315298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:54.377783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.379225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.379708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.380195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.389483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:54.392117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:54.404963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:54.405893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:54.406812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:54.409322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 307/608] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:54.415440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:54.431470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046495-3e23-4cd0-a984-352649935e8a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.467628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.468479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.468591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.468855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.469570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:54.469950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:54.471480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:54.481504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 302/609] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:54.490594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:54.563984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a7fc-142d-4991-aa1d-c629a2eb0f16 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.581250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:54.636177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.640339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.640776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.641195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.642075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:54.645242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:54.646872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:54.677913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 308/610] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:54.679022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:54.705435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab01f6-7f32-467f-a8f9-aa585a4ad966 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.743757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:54.745441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.746131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.746406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.746676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.770695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:54.772162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:54.795410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:54.796418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:54.797285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:54.797285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:54.797285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:54.797285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 303/611] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:54.802208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:54.882500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19110b-d709-437b-87ff-d5b8bf6a2f0d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.933991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e8fc8-19fd-4620-8182-85070d434e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:54.934581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e8fc8-19fd-4620-8182-85070d434e3c None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:54.934854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e8fc8-19fd-4620-8182-85070d434e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:54.935121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e8fc8-19fd-4620-8182-85070d434e3c None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/77470d4430f04d30b64297de78e67f56/roles/fd92aa943af04a3c8616b3cb3138ece2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:54.948747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:54.959160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d1bae-682b-479d-95c4-b612e239e0b2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:54.963159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e8fc8-19fd-4620-8182-85070d434e3c None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=77470d4430f04d30b64297de78e67f56, role_id=fd92aa943af04a3c8616b3cb3138ece2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:54.964659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e8fc8-19fd-4620-8182-85070d434e3c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:54.991250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 309/612] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:54 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/77470d4430f04d30b64297de78e67f56/roles/fd92aa943af04a3c8616b3cb3138ece2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:55.010576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.011242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.011532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.011798 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.012541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:55.012859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.014394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.022038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01061-a784-4256-8904-619ee97a7e79 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.022423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01061-a784-4256-8904-619ee97a7e79 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.022766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01061-a784-4256-8904-619ee97a7e79 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.024922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 310/613] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:55.035611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab33b4-6194-4086-a141-064f0fd44ac7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.035940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab33b4-6194-4086-a141-064f0fd44ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.036157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab33b4-6194-4086-a141-064f0fd44ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.054069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 304/614] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:55.065378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.074870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-31ab33b4-6194-4086-a141-064f0fd44ac7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:55.076435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-31ab33b4-6194-4086-a141-064f0fd44ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:55.204020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 311/615] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:23:55.221664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b178c-f928-4ac3-8406-ee09c554ce1b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.261097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.262066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.262489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.262904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.271212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.273113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:55.295634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:55.296808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:23:55.297963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:55.300126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 305/616] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:55.305638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab33b4-6194-4086-a141-064f0fd44ac7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.311781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:55.445131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab33b4-6194-4086-a141-064f0fd44ac7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.489084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.489814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.490183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.490545 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.491379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:55.491779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.493303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.516142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 312/617] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:55.522053 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.555088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:55.573899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.645570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:55.724268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b4a3a-7cbd-4b45-9051-096d41c4dd49 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.730859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11421647-ec92-4135-be85-7d7ee5c3b371 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.795155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.796617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.797882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.798428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.800444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.801403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.803110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.804275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.813508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:55.818566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:55.819653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:55.820686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:55.828589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 313/618] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:55.830032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.834397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.835896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:55.869121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:55.870471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:55.871332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:55.871332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:55.871332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:55.871332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 306/619] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:55.878940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.942632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0dbc-ac5e-4da2-905d-3dee79d6395f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.963582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:55.979104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7a51-339d-4141-be96-b22434849403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.980142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7a51-339d-4141-be96-b22434849403 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.980142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7a51-339d-4141-be96-b22434849403 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.980345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7a51-339d-4141-be96-b22434849403 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.980942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7a51-339d-4141-be96-b22434849403 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:55.981241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7a51-339d-4141-be96-b22434849403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.982648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7a51-339d-4141-be96-b22434849403 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.991383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 314/620] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:23:55.997090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7a51-339d-4141-be96-b22434849403 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.038078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:56.083800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c798-f790-4713-a8f5-be56e7a2dea1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.119419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84083797-e895-466a-a720-3c70211d07e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.120099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083797-e895-466a-a720-3c70211d07e4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.120381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083797-e895-466a-a720-3c70211d07e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.120650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083797-e895-466a-a720-3c70211d07e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.121307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84083797-e895-466a-a720-3c70211d07e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:56.121741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84083797-e895-466a-a720-3c70211d07e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.123201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84083797-e895-466a-a720-3c70211d07e4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.136832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 307/621] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:56.137314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7a51-339d-4141-be96-b22434849403 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.138174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0238dd-e89e-43b0-aa74-91e44abd0de9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.138482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0238dd-e89e-43b0-aa74-91e44abd0de9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.138786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0238dd-e89e-43b0-aa74-91e44abd0de9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.144445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 308/622] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:56.145249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0238dd-e89e-43b0-aa74-91e44abd0de9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.185693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50023e-ad19-4645-95f4-44daf2884647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.186385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50023e-ad19-4645-95f4-44daf2884647 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.186661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50023e-ad19-4645-95f4-44daf2884647 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.186927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50023e-ad19-4645-95f4-44daf2884647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.201075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50023e-ad19-4645-95f4-44daf2884647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.203198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50023e-ad19-4645-95f4-44daf2884647 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8b50023e-ad19-4645-95f4-44daf2884647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:56.222801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:56.223802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:56.225089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:56.225089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:56.225089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:56.225089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 315/623] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:56.225495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46726-74c1-4260-8525-fc2037e98131 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.225926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46726-74c1-4260-8525-fc2037e98131 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.226201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f46726-74c1-4260-8525-fc2037e98131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.248446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-43f46726-74c1-4260-8525-fc2037e98131 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:56.250372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43f46726-74c1-4260-8525-fc2037e98131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:56.258073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0238dd-e89e-43b0-aa74-91e44abd0de9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.282814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:56.293355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:56.303425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.304052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.304375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.304638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.312578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.314197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:56.326594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:56.327583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:56.328488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:56.332722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 309/624] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:56.333635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.349695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 316/625] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:56.350943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f46726-74c1-4260-8525-fc2037e98131 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.447525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be2e0-d5c6-4b4f-9994-2c0ac40c27f5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.472119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f46726-74c1-4260-8525-fc2037e98131 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.483661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86fe8a-91bc-4e7a-b686-7729f181f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.484289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86fe8a-91bc-4e7a-b686-7729f181f5ac None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.484564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86fe8a-91bc-4e7a-b686-7729f181f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.484830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86fe8a-91bc-4e7a-b686-7729f181f5ac None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.485466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86fe8a-91bc-4e7a-b686-7729f181f5ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:56.485789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86fe8a-91bc-4e7a-b686-7729f181f5ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.487268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86fe8a-91bc-4e7a-b686-7729f181f5ac None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.504723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 310/626] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:56.504723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd8a8-cb70-486e-a09d-9fd644f3d5c1 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.504723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd8a8-cb70-486e-a09d-9fd644f3d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.504723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dd8a8-cb70-486e-a09d-9fd644f3d5c1 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.504723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 311/627] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:56.510855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd8a8-cb70-486e-a09d-9fd644f3d5c1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.514408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4ab6b-edf6-47cc-bffe-fe9de4d33acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.515192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ab6b-edf6-47cc-bffe-fe9de4d33acf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.515676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ab6b-edf6-47cc-bffe-fe9de4d33acf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.516156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ab6b-edf6-47cc-bffe-fe9de4d33acf None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.517076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4ab6b-edf6-47cc-bffe-fe9de4d33acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:56.517627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4ab6b-edf6-47cc-bffe-fe9de4d33acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.519255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4ab6b-edf6-47cc-bffe-fe9de4d33acf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.532568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 317/628] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:56.535288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f68a-3011-4a82-b8b0-b2a0fbe6a034 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.536099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f68a-3011-4a82-b8b0-b2a0fbe6a034 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.536884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f68a-3011-4a82-b8b0-b2a0fbe6a034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.555906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7f87f68a-3011-4a82-b8b0-b2a0fbe6a034 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:56.557480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7f87f68a-3011-4a82-b8b0-b2a0fbe6a034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:56.569131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:56.576170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:56.627426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 318/629] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:56.628991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87f68a-3011-4a82-b8b0-b2a0fbe6a034 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.639849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dd8a8-cb70-486e-a09d-9fd644f3d5c1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.676475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.676870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.677142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.677418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.684954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.686515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:56.698721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:56.700177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:23:56.701802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:56.707175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 312/630] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:23:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:23:56.708139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.736050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87f68a-3011-4a82-b8b0-b2a0fbe6a034 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.771359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.772424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.772929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.773416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/5ba04cf2f81b4a33863e0789b706061e/roles/fd92aa943af04a3c8616b3cb3138ece2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.792029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=5ba04cf2f81b4a33863e0789b706061e, role_id=fd92aa943af04a3c8616b3cb3138ece2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.793859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.821464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27038e-ab46-4968-bd17-250dbf885423 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.822164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 319/631] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:23:56 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/5ba04cf2f81b4a33863e0789b706061e/roles/fd92aa943af04a3c8616b3cb3138ece2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:56.823018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.827596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:56.838419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:56.933970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.934535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.935138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.935138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.953458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:56.961196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:56.962254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:56.963068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:56.964882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526206-dccd-45f7-9448-cdd18ff49c90 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.970781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 313/632] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:56.972099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.018402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.019034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.019311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.019580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.020322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:57.020625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.022590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.044457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 320/633] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:23:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:57.045870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.095748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0ac5-b2c9-49e1-8e85-afa4916dc507 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.133076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.134181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.135224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.135673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.136138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.149465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:57.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:57.156103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:57.156919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:57.159726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 314/634] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:57.160725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.187041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a38144-fb1f-415d-b208-2011848d9984 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.199785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.228542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.229468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.229901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.230310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.231120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:57.231692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.233113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.242377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 321/635] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:57.243202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.291167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0a29-450c-43ca-9f8d-5985fdb2effa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.328549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.329146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.329425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.329778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.342347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5bbba-d974-4932-933f-3658a901914a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.366199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.380461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e956d88-eeb6-48db-875b-de219c4bdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.381075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956d88-eeb6-48db-875b-de219c4bdf4f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.381354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956d88-eeb6-48db-875b-de219c4bdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.381642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e956d88-eeb6-48db-875b-de219c4bdf4f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.382564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e956d88-eeb6-48db-875b-de219c4bdf4f None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:57.382867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e956d88-eeb6-48db-875b-de219c4bdf4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.384771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e956d88-eeb6-48db-875b-de219c4bdf4f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.402742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 322/636] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:57.402742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae052-d533-4ab7-a976-5e0607c5d62e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.402742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae052-d533-4ab7-a976-5e0607c5d62e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.402742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faae052-d533-4ab7-a976-5e0607c5d62e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.402742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 323/637] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:57.402742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faae052-d533-4ab7-a976-5e0607c5d62e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.408572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.410063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.438019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.514607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faae052-d533-4ab7-a976-5e0607c5d62e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.523104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 315/638] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:57.523104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.552073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bda3c-d7a5-46cd-a0e9-f0493d7634b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.552855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bda3c-d7a5-46cd-a0e9-f0493d7634b1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.553127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bda3c-d7a5-46cd-a0e9-f0493d7634b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.553725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bda3c-d7a5-46cd-a0e9-f0493d7634b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.564685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bda3c-d7a5-46cd-a0e9-f0493d7634b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.566195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bda3c-d7a5-46cd-a0e9-f0493d7634b1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-181bda3c-d7a5-46cd-a0e9-f0493d7634b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:57.581027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:57.582014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:57.582895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:57.582895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:57.582895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:57.586934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 324/639] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:57.588284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7734de-a568-49d3-bb97-7ae4cefca9a1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.588559 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7734de-a568-49d3-bb97-7ae4cefca9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.588825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7734de-a568-49d3-bb97-7ae4cefca9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.606255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fc7734de-a568-49d3-bb97-7ae4cefca9a1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:57.607427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fc7734de-a568-49d3-bb97-7ae4cefca9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:57.630703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d09c6-1d96-4b5e-8db5-89630e950d1e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.638806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.658815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.668793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.669567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.669749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.669974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.689644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 325/640] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:57.689806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.689917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7734de-a568-49d3-bb97-7ae4cefca9a1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.690006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:57.706061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:57.707204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:57.708103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:57.708103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:57.708103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:57.708103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 316/641] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:57.708489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.804596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7734de-a568-49d3-bb97-7ae4cefca9a1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.840151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c892-7b60-42eb-975a-e97b7bb572ba None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:57.841291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.842139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.842740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.843116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.855668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.857466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:57.874433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:57.875494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:57.876376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:57.876376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:57.876376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:57.876376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 326/642] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:57.877383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.895791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:57.896401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:57.896681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:57.896946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:57.898343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:57.898343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:57.899490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:57.908821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.917824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 317/643] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:57.918758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:57.959996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:57.995613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18712abd-e554-492d-8a15-49140b7a96a3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.030541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4570c-9864-415f-baa6-3ffbf0f9cab2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.031643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.032229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.032533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.032765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.033772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:58.033772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.035194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.051629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 327/644] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:58.051629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.076167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.076789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.077197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.077471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.078195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:58.078499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.080013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.096479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 318/645] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:58.096479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.135593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.157315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3914a7-92be-469c-9f50-1151c05f39dd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.192282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.192964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.193311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.193611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.199103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.200695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.202264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.204510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505119d7-9dfb-4ffa-b96f-7f8b160fd89c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:58.214111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:58.215094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 328/646] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:58.216073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.245336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.246000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.246280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.246552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.257782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:23:58.264306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:58.266161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:23:58.267234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:58.273158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 319/647] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:58.273158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.337295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ac603-52ba-4e4e-b7ed-d2207ab8ef6f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.372354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.373126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.373483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.373890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.374990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e40cff-e5bb-4199-a829-fcf6225e90eb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.382211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.383958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.388486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:58.400484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:58.401674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:23:58.402818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:58.406542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 329/648] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:58.407585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.419240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.419996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.420365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.420780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.427872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.429412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:23:58.440996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:58.442110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:58.443106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 320/649] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:58.443657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.468019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.525046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3036d-b994-47be-b642-176ec81d1d7d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.554901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba8e2a-9937-42cc-8cf5-dee7e8f81aad None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.561396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.562112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.562453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.562806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.564015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:58.564380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.566276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.585891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 330/650] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:58.587033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.597847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.598373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.598650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.598918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.599682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:58.599890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.601257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.609828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 321/651] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:58.610609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.653091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.697174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695e01b-e3d0-4183-bc4f-7335dcd45be4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.700668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.721468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33701d3e-9fa1-4d7b-96a7-18d84961545c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.743183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.743798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.744171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.744430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.745057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:58.745341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.747616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.757087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.757755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.758071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.758348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.759080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:58.759385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.760891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.767279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 331/652] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:58.768333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.777903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 322/653] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:58.779172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.886464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7687616-ef59-4a37-aa44-f3a6e336c135 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.888085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f2185-cf99-4b44-91f9-5a51d07f85f3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:58.903416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.921415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.922051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.922334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.922603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.928737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:58.929362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:58.929668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:58.929937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:58.938039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:58.940446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.942089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:58.957343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:58.958470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:58.959490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:58.959490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:58.959490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:58.963672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 323/654] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:58.964428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:58.990348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:58.991749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.064565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0366c-4ea0-4b42-8e6c-3ece39641600 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.089428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 332/655] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:59.090328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.103564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.104240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.104521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.104791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.107281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.163185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.173063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.174581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.190216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1676800-e18e-4526-8ed7-0c3799154cf9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.227167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485ce0-0c11-4e95-882c-47393ea2c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.227772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485ce0-0c11-4e95-882c-47393ea2c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.228051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485ce0-0c11-4e95-882c-47393ea2c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.228318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485ce0-0c11-4e95-882c-47393ea2c5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.229050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485ce0-0c11-4e95-882c-47393ea2c5c6 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=aa4e1f12814a4923a2a37d771c59d40c) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:59.229358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485ce0-0c11-4e95-882c-47393ea2c5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.230850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485ce0-0c11-4e95-882c-47393ea2c5c6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.236676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 333/656] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/role_assignments?user.id=aa4e1f12814a4923a2a37d771c59d40c&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:59.237854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7891f-caee-4e90-94f9-8d0653aab89f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.238135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7891f-caee-4e90-94f9-8d0653aab89f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.238406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7891f-caee-4e90-94f9-8d0653aab89f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.239597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 334/657] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:23:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:23:59.240292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7891f-caee-4e90-94f9-8d0653aab89f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.294988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 324/658] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:23:59.295856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.352694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.379221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7891f-caee-4e90-94f9-8d0653aab89f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.405608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.415932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2658c1a-cde5-4178-859e-752eb3f37435 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.422110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d9291-52e0-4c63-a435-cfb275bf61e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.422996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d9291-52e0-4c63-a435-cfb275bf61e7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.423425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d9291-52e0-4c63-a435-cfb275bf61e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.423914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d9291-52e0-4c63-a435-cfb275bf61e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.424589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d9291-52e0-4c63-a435-cfb275bf61e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:59.424891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d9291-52e0-4c63-a435-cfb275bf61e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.426306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d9291-52e0-4c63-a435-cfb275bf61e7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.439783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 335/659] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:59.446485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d09de-e201-47b2-aea4-2e460eae50c5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.446485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d09de-e201-47b2-aea4-2e460eae50c5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.446687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d09de-e201-47b2-aea4-2e460eae50c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.454190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.454831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.455110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.455381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.465932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.467464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.468881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-664d09de-e201-47b2-aea4-2e460eae50c5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:59.470174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-664d09de-e201-47b2-aea4-2e460eae50c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:59.485291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:59.486357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:59.487235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:59.487235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:59.487235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:59.487235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 325/660] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:59.488052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.549991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 336/661] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:23:59.550769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d09de-e201-47b2-aea4-2e460eae50c5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.605733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4f4d4-04ff-4a62-9a07-51885bfd1d95 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.641934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.644524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.645931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.646435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.646914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.660441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.662248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.665366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:23:59.679245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:59.680506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:23:59.681748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:23:59.681748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:23:59.681748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:23:59.684676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d09de-e201-47b2-aea4-2e460eae50c5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.687447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 326/662] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:59.688376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.731656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.733198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.733660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.734073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.744656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.746553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:23:59.763344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:23:59.764385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:23:59.765796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 337/663] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:23:59.770434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.797819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13ce69-6b60-45d1-b8c5-de5621aa242b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.831919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.832451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.832727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.832996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.833673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:59.833980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.835420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.847790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 327/664] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:59.848624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.878880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5c241-ad92-4a9f-bd07-4103f339761e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.906726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.915269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:59.922605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.923440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.923866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.924306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.924952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:59.925255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:59.926914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:59.945487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 338/665] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:59.946404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:59.960048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611dfdb-a211-4aa9-8074-0d423a4dcd8d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:59.997145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:59.997767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:59.998049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:59.998319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:59.999215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:59.999536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.001066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.024334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 328/666] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:00.025013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.052033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5159d-7471-43d9-b65f-c92716492961 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.087995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.088552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.088831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.089165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.095954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.097401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:00.108450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:00.109530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:00.110709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:00.114419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 339/667] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:23:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:00.115115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.135794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe72517-1dcf-4429-9717-eb78ae797001 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.151258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.166178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.175830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.176562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.176849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.177116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.189161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:00.194830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:00.195806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:00.196666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 329/668] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:00.197359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.220695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d81f3-fc88-414a-a9a0-ede5859b349b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.260166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.260832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.261106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.261372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.268786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.270350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:00.282499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:00.283608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:00.284708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:00.285854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 340/669] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:00.287883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.310964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5437ca1-0600-4a64-9f90-f17439a16451 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.348720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.349256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.349534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.349831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.405775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.409333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22363b07-d404-460a-b2b7-718a66a496ba None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.421285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.437946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.439600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.446676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.447387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.447738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.448082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.448871 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:00.449152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.450623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.468650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 341/670] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:00.469840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.548414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 330/671] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:24:00.549273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.573381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd155-91cd-48ec-bedf-d4a3e4d6bc14 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.609922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.610605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.610978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.611360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.612093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:00.612458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.613939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.626360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 342/672] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:00.626360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.626625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.656531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1919d6d-fcc0-4f16-a159-48afb7e5fee2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.658998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.692792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.693710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.694147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.694558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.695391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:00.695871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.697317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.709232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 331/673] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:00.710150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.736295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae5414-df5b-4c75-99f5-cb6915faf058 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.772045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.772797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.773203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.773600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.774397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=4d3160eee18a4f7cb9f6880ec1b672a1) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:00.774704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.776233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.782652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 343/674] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/role_assignments?user.id=4d3160eee18a4f7cb9f6880ec1b672a1&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:00.783522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.834634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c89f-3e81-4236-a8bd-fab87a254af0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.884200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.885045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.885324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.885622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.888805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.902922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.904738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.906498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.912219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ebaba-f09c-423e-b476-bcc336a9a1b8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:00.927928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:00.929453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:00.930480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:00.930480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:00.930480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:00.934513 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 332/675] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:00.935695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.959023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.960457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.960983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.961462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.975294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.977089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:00.994774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:00.995788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:00.996685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:00.996685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:00.996685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:00.998593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 344/676] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:00.999652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.071917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446fa0d-ba7a-4810-bf5e-d18f2f0c0958 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.122779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.123390 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.123721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.123989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.124722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=5301330fc789466ab0c1c4aae41b6330) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:01.125026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:01.126545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:01.133241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 333/677] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/role_assignments?user.id=5301330fc789466ab0c1c4aae41b6330&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:01.134287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.141582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0c6b7-4ab6-46e4-923b-ef8ff4adb603 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.211477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.212099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.212373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.212640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.213297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:01.213619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:01.215024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:01.238791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 345/678] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:01.239590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:01.246484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.263488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:01.308939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552daa0-2717-472a-8c99-9011b10e23c5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.356167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a067c-b967-4a73-a787-cadac1f87a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.357065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a067c-b967-4a73-a787-cadac1f87a9c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.357510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a067c-b967-4a73-a787-cadac1f87a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.358026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a067c-b967-4a73-a787-cadac1f87a9c None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.358827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a067c-b967-4a73-a787-cadac1f87a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:01.359270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a067c-b967-4a73-a787-cadac1f87a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:01.360799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a067c-b967-4a73-a787-cadac1f87a9c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:01.377115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 334/679] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:01.379202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3120-3f1e-455b-b36e-7a38e027e574 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.379718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3120-3f1e-455b-b36e-7a38e027e574 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.380188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce3120-3f1e-455b-b36e-7a38e027e574 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.381991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 335/680] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:01.388574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674d2f-f4fa-47bc-9f4b-2f368aa0bfec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.390572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77e0c8-a2b3-40cc-8b97-6533704a1120 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.392001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77e0c8-a2b3-40cc-8b97-6533704a1120 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.392497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77e0c8-a2b3-40cc-8b97-6533704a1120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.415681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2c77e0c8-a2b3-40cc-8b97-6533704a1120 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:01.417309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2c77e0c8-a2b3-40cc-8b97-6533704a1120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:01.441655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.443336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.443848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.444467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.454923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:01.456738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:01.471841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:01.472783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:01.473776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:01.475220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 346/681] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:01.475831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.501604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 336/682] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:24:01.501604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77e0c8-a2b3-40cc-8b97-6533704a1120 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.577738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:01.606171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:01.669356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d6e6-9cb7-4977-b0c3-93be0fd0cb05 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.683067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77e0c8-a2b3-40cc-8b97-6533704a1120 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.726152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.727739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.729283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.729781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.730956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:01.732324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:01.734569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:01.746234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.747012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.747489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.747833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.748022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 337/683] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:01.754485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.771074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:01.772742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:01.796524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:01.797787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:01.798956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:01.800757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 347/684] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:01.801527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.894075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:01.897992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb52c60-13f7-4958-9245-1297755cdf28 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.912309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad51a7-6f75-4756-b41f-92604e8cc0e5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:01.941069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.941925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:01.942439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.942867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.943274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.944150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=77470d4430f04d30b64297de78e67f56) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:01.944611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:01.946189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:01.951221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:01.952012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.952377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.952740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.957722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 338/685] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/role_assignments?user.id=77470d4430f04d30b64297de78e67f56&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:01.958862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:01.965580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:01.969682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:01.970870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:01.971910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:01.973814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 348/686] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:01.981592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:02.107332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83378c-95c0-47a9-8721-97bad4951680 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.149989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:02.150749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:02.151171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:02.151532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:02.155525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:02.155525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:02.155525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:02.164623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 349/687] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:02.170844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:02.199618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e768-bd7f-40d4-be19-ddae2ba72cf5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.233914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:02.292065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:02.293011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:02.293293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:02.293605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:02.294361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:02.294667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:02.295156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66afbf5-4757-40fe-98a1-b19102bfc1ab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.296134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:02.319880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 339/688] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 30 00:24:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:02.325496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:02.338776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:02.339434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:02.339708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:02.339972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:02.353636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:02.355086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:02.358069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:02.372202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:02.373212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:02.374215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:02.374215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:02.374215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:02.374215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 350/689] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:02.382851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:02.451221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f309858-f505-43ba-a67f-92ecc07ef9fc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.495932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:02.497258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:02.497663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:02.498029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:02.510783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03ac75-ae0d-472c-804a-d64c6352e3c2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.512787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:02.554351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:02.555535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:02.555915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:02.556284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:02.557301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:02.557726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:02.559916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:02.576164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 351/690] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:02.582832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:02.590872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:02.592651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:02.617628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:02.703243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 340/691] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:24:02.709106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:02.716748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5f97-30b3-4e56-a106-55cff748cf51 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.767039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:02.767679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:02.767957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:02.768224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:02.780335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:02.782122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:02.797586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:02.798589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:02.799506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 352/692] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:24:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:02.804987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:02.846564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15669e-e0c1-48f2-b411-a1f7173579a4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.851590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:02.895901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:02.916705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:02.917745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:02.918216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:02.918676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:02.941570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:02.943926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:02.953763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f83e53-99f3-4442-a1d4-1b295ab20d57 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:02.965395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:02.966378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:02.967254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:02.967254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:02.967254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:02.969514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 341/693] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:02.975374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.021889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c6f3c-4006-46ec-97e6-bd94b480434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.022572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6f3c-4006-46ec-97e6-bd94b480434f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.022822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6f3c-4006-46ec-97e6-bd94b480434f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.023102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6f3c-4006-46ec-97e6-bd94b480434f None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.023850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c6f3c-4006-46ec-97e6-bd94b480434f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:03.024147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c6f3c-4006-46ec-97e6-bd94b480434f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.025604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c6f3c-4006-46ec-97e6-bd94b480434f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.047362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 353/694] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:24:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:03.049029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eb649-76a5-4a3a-a851-c01019386c15 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.049404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eb649-76a5-4a3a-a851-c01019386c15 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.050211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eb649-76a5-4a3a-a851-c01019386c15 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.052055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 354/695] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:03.052840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eb649-76a5-4a3a-a851-c01019386c15 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.094562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074ba03-23bb-45eb-a2da-bc8635d52061 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.131944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffcefc-46a3-44f3-8cd5-6462b811dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.132766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffcefc-46a3-44f3-8cd5-6462b811dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.133127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffcefc-46a3-44f3-8cd5-6462b811dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.133465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffcefc-46a3-44f3-8cd5-6462b811dcc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.134211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffcefc-46a3-44f3-8cd5-6462b811dcc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:03.134930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffcefc-46a3-44f3-8cd5-6462b811dcc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.136619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffcefc-46a3-44f3-8cd5-6462b811dcc1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.156814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 342/696] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:03.156814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9515-de40-4d85-9dc3-b577723121ac None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.156814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9515-de40-4d85-9dc3-b577723121ac None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.156814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9515-de40-4d85-9dc3-b577723121ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.162815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:03.176705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0a0e9515-de40-4d85-9dc3-b577723121ac None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:03.178400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0a0e9515-de40-4d85-9dc3-b577723121ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:03.187008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eb649-76a5-4a3a-a851-c01019386c15 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.210660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:03.227669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.228716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.229224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.229724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.260750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 343/697] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:24:03.261758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e9515-de40-4d85-9dc3-b577723121ac None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.320937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.323040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.381090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e9515-de40-4d85-9dc3-b577723121ac None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.415473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.416113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.416392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.416659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.417735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:03.424295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.426811 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:03.440823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:03.441785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:03.442688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 344/698] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:03.450505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.464770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 355/699] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:24:03.469802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.494492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:03.583373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230997-6a94-41f8-a5c4-76ddbbacc169 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.591244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493685-6451-4761-a3dc-8854beba5dbc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.621372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9931800-2aa7-401c-ba1c-8a172306406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.622197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931800-2aa7-401c-ba1c-8a172306406d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.622405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931800-2aa7-401c-ba1c-8a172306406d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.622683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931800-2aa7-401c-ba1c-8a172306406d None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.623382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9931800-2aa7-401c-ba1c-8a172306406d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:03.623724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9931800-2aa7-401c-ba1c-8a172306406d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.625244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9931800-2aa7-401c-ba1c-8a172306406d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.631469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.632347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.632621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.632882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.638766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 345/700] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:03.640223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6784-fbd6-4ee9-b506-ff90ff1cf2a9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.640506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6784-fbd6-4ee9-b506-ff90ff1cf2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.640775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6784-fbd6-4ee9-b506-ff90ff1cf2a9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.642352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 346/701] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:03.643058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6784-fbd6-4ee9-b506-ff90ff1cf2a9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.647716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.649180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:03.665430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:03.666682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:03.667616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:03.667616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:03.667616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:03.667616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 356/702] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:03.667616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.702455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:03.742148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:03.760164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6784-fbd6-4ee9-b506-ff90ff1cf2a9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.775514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6808-bdc3-4d96-b562-26597148e2d2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.795609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.796243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.796521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.796787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.812185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.813663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.813953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cb3a5-0e96-43d0-b57d-171de5001108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:03.814599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cb3a5-0e96-43d0-b57d-171de5001108 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.814865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cb3a5-0e96-43d0-b57d-171de5001108 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.815135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cb3a5-0e96-43d0-b57d-171de5001108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.815862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cb3a5-0e96-43d0-b57d-171de5001108 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=5ba04cf2f81b4a33863e0789b706061e) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:03.816153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cb3a5-0e96-43d0-b57d-171de5001108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:03.817579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cb3a5-0e96-43d0-b57d-171de5001108 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:03.823787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 357/703] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/role_assignments?user.id=5ba04cf2f81b4a33863e0789b706061e&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:03.830766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:03.831789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:03.832692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:03.832692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:03.832692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:03.832692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 347/704] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:03.833731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.834212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af271dd-5d71-49db-bfe9-d8ddcaf62a61 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:03.834735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af271dd-5d71-49db-bfe9-d8ddcaf62a61 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:03.835236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af271dd-5d71-49db-bfe9-d8ddcaf62a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:03.863056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3af271dd-5d71-49db-bfe9-d8ddcaf62a61 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:03.866006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3af271dd-5d71-49db-bfe9-d8ddcaf62a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:03.961574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 358/705] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:24:03.961574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af271dd-5d71-49db-bfe9-d8ddcaf62a61 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:03.973826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2ec70-cf61-4b8d-a16d-98c6a4f3aceb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:03.993828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:04.012827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.013442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.013758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.014029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.014718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:04.015015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.016381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.018878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:04.030131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 348/706] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:04.036332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:04.087740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af271dd-5d71-49db-bfe9-d8ddcaf62a61 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.148110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.148730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.149007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.149273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.149952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:04.150257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.151646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.168570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 359/707] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:04.169821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:04.175361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64bff-257e-402d-9054-938dc6dac127 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.216867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.217765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.218128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.218582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.226320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.228038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:04.240964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:04.242066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:04.242978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:04.243653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 349/708] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:04.249169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:04.265873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:04.283189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea38225-5e1d-4f39-8d24-b469983badde None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.314832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:04.322991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.323186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.323372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.323619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.324239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.326070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.351749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 360/709] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:24:04 2022] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:04.352424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:04.372194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b92715-d0ad-4457-a71a-ccd8e2dcc774 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.413965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.414581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.414859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.415130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.415840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:04.416145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.417608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.430878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 350/710] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:04.436898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:04.490031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a263b7-d671-49d6-a44a-e75db623b4fc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.530629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc51e1a-1db2-4d63-9f8f-fcf732d15c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.531720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51e1a-1db2-4d63-9f8f-fcf732d15c98 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.532274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51e1a-1db2-4d63-9f8f-fcf732d15c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.532741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51e1a-1db2-4d63-9f8f-fcf732d15c98 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.533716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc51e1a-1db2-4d63-9f8f-fcf732d15c98 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.535499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc51e1a-1db2-4d63-9f8f-fcf732d15c98 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ccc51e1a-1db2-4d63-9f8f-fcf732d15c98 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:04.548560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:04.549814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:04.550872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:04.551713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801187e8-21ef-4fc7-b1eb-8b244706a628 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.553357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 361/711] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 30 00:24:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:04.558971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eec11-d69c-43f5-bef8-06009296382e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.559467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eec11-d69c-43f5-bef8-06009296382e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.559914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eec11-d69c-43f5-bef8-06009296382e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.561430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 362/712] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:04.563123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eec11-d69c-43f5-bef8-06009296382e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:04.569015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:04.573907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:04.590958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354c65-ca31-404b-a29b-b12ad8358f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.590958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354c65-ca31-404b-a29b-b12ad8358f70 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.590958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354c65-ca31-404b-a29b-b12ad8358f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.591329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354c65-ca31-404b-a29b-b12ad8358f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.591901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354c65-ca31-404b-a29b-b12ad8358f70 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=aa4e1f12814a4923a2a37d771c59d40c) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:04.592257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354c65-ca31-404b-a29b-b12ad8358f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.593727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354c65-ca31-404b-a29b-b12ad8358f70 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.601046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 351/713] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:04 2022] GET /identity/v3/role_assignments?user.id=aa4e1f12814a4923a2a37d771c59d40c&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:04.602444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1248497-42b1-4b92-9416-3cdf3f5cef47 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.602846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1248497-42b1-4b92-9416-3cdf3f5cef47 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.603197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1248497-42b1-4b92-9416-3cdf3f5cef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.624896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d1248497-42b1-4b92-9416-3cdf3f5cef47 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:04.626366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d1248497-42b1-4b92-9416-3cdf3f5cef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:04.708042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 352/714] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:24:04.717894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eec11-d69c-43f5-bef8-06009296382e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.757524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.758492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.759134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.759582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.760420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:04.760870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.762467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.768281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 363/715] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 30 00:24:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:04.774299 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1248497-42b1-4b92-9416-3cdf3f5cef47 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:04.880476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1248497-42b1-4b92-9416-3cdf3f5cef47 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:04.892221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:04.916027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:04.916633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:04.916948 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:04.917215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:04.917875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:04.918169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:04.919615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:04.925812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 353/716] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 30 00:24:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:05.078810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:05.156035 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:05.191540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f01b-7195-4642-8a0b-cf108ffb0e55 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:05.232291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:05.233021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:05.233295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:05.233569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:05.234170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:05.235536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:05.245713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:05.248005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:05.250118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 364/717] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:05 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:05.257776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:05.415888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028176-a7bf-4104-a4ed-2ffc453b5bbe None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:05.466090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9ed1-0452-4bfb-82e9-b7e36b481452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:05.466703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9ed1-0452-4bfb-82e9-b7e36b481452 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:05.466978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9ed1-0452-4bfb-82e9-b7e36b481452 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:05.467329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9ed1-0452-4bfb-82e9-b7e36b481452 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:05.467966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9ed1-0452-4bfb-82e9-b7e36b481452 None admin] RBAC: Adding query filter params (name=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:05.468264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9ed1-0452-4bfb-82e9-b7e36b481452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:05.469665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9ed1-0452-4bfb-82e9-b7e36b481452 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:05.477440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 354/718] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:05.483062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:05.616337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82550194-2a59-4398-b878-71f59b05a70b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:05.662867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1065-9068-4911-a9a4-f1c516a0f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:05.663508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1065-9068-4911-a9a4-f1c516a0f69b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:05.663785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1065-9068-4911-a9a4-f1c516a0f69b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:05.664049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1065-9068-4911-a9a4-f1c516a0f69b None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:05.664771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1065-9068-4911-a9a4-f1c516a0f69b None admin] RBAC: Adding query filter params (type=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:05.665072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1065-9068-4911-a9a4-f1c516a0f69b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:05.666968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1065-9068-4911-a9a4-f1c516a0f69b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:05.668455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:05.675491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 365/719] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:06.333041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39fe34-ded0-4931-9aec-992898e36bc4 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:06.333664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39fe34-ded0-4931-9aec-992898e36bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:06.333952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39fe34-ded0-4931-9aec-992898e36bc4 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:06.335731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 355/720] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:06.340936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b726e-8356-4cb7-bec5-fcf9a479e8d4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:06.341380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b726e-8356-4cb7-bec5-fcf9a479e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:06.341604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b726e-8356-4cb7-bec5-fcf9a479e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:06.366565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7c1b726e-8356-4cb7-bec5-fcf9a479e8d4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:06.367783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c1b726e-8356-4cb7-bec5-fcf9a479e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:06.472175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 366/721] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:24:06.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39fe34-ded0-4931-9aec-992898e36bc4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:06.931725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:06.932749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384531-172c-47b2-aac2-b33975c7a799 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:06.932749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384531-172c-47b2-aac2-b33975c7a799 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:06.933094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384531-172c-47b2-aac2-b33975c7a799 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:06.934542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 367/722] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:06.940465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212247-e51f-4386-b0e0-64fa019f77cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:06.940742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212247-e51f-4386-b0e0-64fa019f77cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:06.941016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212247-e51f-4386-b0e0-64fa019f77cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:06.962142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-14212247-e51f-4386-b0e0-64fa019f77cf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:06.963610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-14212247-e51f-4386-b0e0-64fa019f77cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:07.018074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39fe34-ded0-4931-9aec-992898e36bc4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:07.043377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 368/723] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:24:07.044664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5290b-c20e-4972-8302-da83d211eeeb None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.044949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5290b-c20e-4972-8302-da83d211eeeb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.045220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5290b-c20e-4972-8302-da83d211eeeb None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.054814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 369/724] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:07.058306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:07.058946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.059222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.059488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.062207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa00f0-6806-4c9a-b055-840c2f2828a2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.062479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa00f0-6806-4c9a-b055-840c2f2828a2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.062745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa00f0-6806-4c9a-b055-840c2f2828a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.084339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:07.087810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-89aa00f0-6806-4c9a-b055-840c2f2828a2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:07.089052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-89aa00f0-6806-4c9a-b055-840c2f2828a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:07.089260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:07.091050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:07.092121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 356/725] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:07.102971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:07.208739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:07.247226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 370/726] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 00:24:07.251294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:07.256010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00eaf9-8e00-4cea-a187-cb381e732480 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:07.301463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1f6c9-2ac2-43a4-bf92-71036141904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:07.302342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1f6c9-2ac2-43a4-bf92-71036141904e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.303472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1f6c9-2ac2-43a4-bf92-71036141904e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.303472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1f6c9-2ac2-43a4-bf92-71036141904e None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.303778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1f6c9-2ac2-43a4-bf92-71036141904e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:07.304052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1f6c9-2ac2-43a4-bf92-71036141904e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:07.306571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1f6c9-2ac2-43a4-bf92-71036141904e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:07.330201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 357/727] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:07.335640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa00f0-6806-4c9a-b055-840c2f2828a2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:07.370664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763729-9506-4ba3-a237-3f8d31646224 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.371222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763729-9506-4ba3-a237-3f8d31646224 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.371222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97763729-9506-4ba3-a237-3f8d31646224 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.372917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 358/728] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:07.378997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487fe7-cef2-4571-97cd-09d519965a5b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.379141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487fe7-cef2-4571-97cd-09d519965a5b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.379338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487fe7-cef2-4571-97cd-09d519965a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.400100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c1487fe7-cef2-4571-97cd-09d519965a5b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:07.401292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c1487fe7-cef2-4571-97cd-09d519965a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:07.448822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa00f0-6806-4c9a-b055-840c2f2828a2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:07.489659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 359/729] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:24:07.489659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487fe7-cef2-4571-97cd-09d519965a5b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:07.503721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:07.504599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.505026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.505434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.523117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:07.524937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:07.551307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:07.552412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:07.553508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:07.553508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:07.553508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:07.556266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 371/730] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:07.561451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:07.607492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:07.635922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:07.647903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487fe7-cef2-4571-97cd-09d519965a5b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:07.673762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec390d0-62af-4731-bdbe-3dab12f116d9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:07.690468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:07.691504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.692191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.692605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.706007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:07.709087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:07.709964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.710400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.710822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:07.711060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:07.712128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 360/731] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:07.717839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:07.732708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:07.738780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:07.739743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:07.740578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:07.747774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 372/732] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:24:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:07.749038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:07.821311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c05eea-2d70-489c-b7a3-0ca7340838e7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:07.849953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:07.853179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5459c-8480-47d5-9be2-d3a75498b75f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:07.866482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:07.867097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.867371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.867639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.868355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:07.868656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:07.870087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:07.886933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 361/733] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:07.886933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:07.892367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:07.892978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:07.893255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:07.893520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:07.894485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:07.894485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:07.895850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:07.898885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:07.904734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 373/734] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:07.905518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.000474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282b93-aef5-4884-b099-a7a56ddc244f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.012635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9a07-1a53-4930-ac4e-af9e94add1ec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.036262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.036869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.037148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.037415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.038103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:08.038645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.039757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.048129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 362/735] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:24:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:08.048926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.054736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.055554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.055837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.056105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.056759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.058169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.078039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 374/736] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:07 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:08.078931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.108958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.157833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.197301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277e8f9-ba8f-4196-ae91-751adaea1c58 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.219858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b5c42-a99b-47a8-993a-d174abb924a3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.239761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.240405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.240681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.240952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.251167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.251984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.258460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2278a-72e3-4ad6-ac50-dde6b2336649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.259101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2278a-72e3-4ad6-ac50-dde6b2336649 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.259379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2278a-72e3-4ad6-ac50-dde6b2336649 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.259656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2278a-72e3-4ad6-ac50-dde6b2336649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:08.267580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:08.268508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:08.269435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:08.269987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 363/737] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:08.270921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.272660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2278a-72e3-4ad6-ac50-dde6b2336649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.274212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2278a-72e3-4ad6-ac50-dde6b2336649 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-cfc2278a-72e3-4ad6-ac50-dde6b2336649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:08.290419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:08.291416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:08.292367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:08.292367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:08.292367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:08.293108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 375/738] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:08.294602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d69cd-c700-4137-b1c8-3be9fb81df68 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.295098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d69cd-c700-4137-b1c8-3be9fb81df68 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.295656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d69cd-c700-4137-b1c8-3be9fb81df68 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.297251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 376/739] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:08.298259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d69cd-c700-4137-b1c8-3be9fb81df68 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.374928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.399867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61814d68-8b50-46c8-8eeb-2a2315e672d0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.410662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d69cd-c700-4137-b1c8-3be9fb81df68 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.428577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.434340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.434976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.435254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.435520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.446372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.447820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.450401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d87710-c4ed-4c50-b434-421dd83bbac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.451583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d87710-c4ed-4c50-b434-421dd83bbac6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.452029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d87710-c4ed-4c50-b434-421dd83bbac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.452464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d87710-c4ed-4c50-b434-421dd83bbac6 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.453358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d87710-c4ed-4c50-b434-421dd83bbac6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:08.453870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d87710-c4ed-4c50-b434-421dd83bbac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.455503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d87710-c4ed-4c50-b434-421dd83bbac6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:08.461820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:08.462942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:08.463827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:08.463827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:08.463827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:08.463827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 364/740] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:08.463827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.479227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 377/741] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:08.480768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b35d2-09ac-4486-a709-964160825bd5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.481048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b35d2-09ac-4486-a709-964160825bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.481316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b35d2-09ac-4486-a709-964160825bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.500201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-577b35d2-09ac-4486-a709-964160825bd5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:08.501427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-577b35d2-09ac-4486-a709-964160825bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:08.585636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 378/742] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:24:08.585636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b35d2-09ac-4486-a709-964160825bd5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.585943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4c646-8909-41aa-836c-eb891a9c107f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.616889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.617498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.617792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.618056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.618993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:08.619289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.620690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.638914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 365/743] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:08.639866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.657335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.688056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.710717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b35d2-09ac-4486-a709-964160825bd5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.754518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed3dbb-bbf1-4d61-a3e9-55f673e1d8ad None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.754973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.755635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.755910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.756362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.757739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:08.758059 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.759673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.773975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 379/744] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:08.775236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.795705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.796435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.796777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.797106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.871358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.873076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.895479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b57b0-0848-434b-b0fa-b17fcb8610e7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:08.912885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.922729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:08.931377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:08.932011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:08.932283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:08.932548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:08.940216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:08.941671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:08.953589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:08.954715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:08.955936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:08.959284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 380/745] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:08.960020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:08.989812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 366/746] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:24:08.989812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.068777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbd6c2-78bc-4dea-9c2d-0a03f17ec50f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.094711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65be60-f398-4f74-9f30-a7d88d17fbaa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.107044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.107772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.108047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.108313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.116451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.117915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:09.131579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:09.132503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:09.133436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 381/747] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:24:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:09.134585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.138753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.139398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.139674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.139943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.140590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.141966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.165826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 367/748] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:08 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:09.165826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.168909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:09.195364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:09.282005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f67b6-5aec-4bcd-8204-10d64a7bcc87 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.320878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c7b4c-7623-45a0-95c2-42600c3cffeb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.331253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.334029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.334530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.334849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.335538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:09.340153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.342934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.366229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 382/749] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:09.366524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.367075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.367201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.367403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.367672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.382376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.383898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:09.400534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:09.401849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:09.402733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:09.402733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:09.402733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:09.402733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 368/750] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:09.402963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.465661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:09.473304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:09.479666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488992f-e6d2-4c1f-a77b-3d3b30a221ec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.515509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.516494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.517000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.517467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.518460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:09.518965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.520195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432af62-ffdb-430b-80f8-6463ecf0fec1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.520856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.539171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 383/751] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:09.540321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.564996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.566222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.567037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.567512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.583144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.585046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:09.602722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:09.603702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:09.604583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:09.604583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:09.604583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:09.606800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 369/752] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:09.607796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.681584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478fad7-2f18-4b12-9c7d-4777623d7187 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.717280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.717925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.718201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.718530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.719190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:09.719555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.720997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.734271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 384/753] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:09.735191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.770154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:09.842463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10790d-11c4-4d90-8624-5bec4532b6e6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.845258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:09.892474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.893118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.893396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.893724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.910569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fc96c-5012-40c1-9a78-157908f2b7bf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:09.956809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:09.957423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:09.957734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:09.958007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:09.959053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:09.959354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.961305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:09.977431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 385/754] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:09.978322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:09.995550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:09.997826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.065930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.091316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d569b-b173-426a-9224-d20d76283980 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.116066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 370/755] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:10.116842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.121744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.128564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2697a0c-f760-4665-a52b-c913460bebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.129197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2697a0c-f760-4665-a52b-c913460bebbb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.129469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2697a0c-f760-4665-a52b-c913460bebbb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.129762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2697a0c-f760-4665-a52b-c913460bebbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.136432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2697a0c-f760-4665-a52b-c913460bebbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.137895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2697a0c-f760-4665-a52b-c913460bebbb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f2697a0c-f760-4665-a52b-c913460bebbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:10.149443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:10.150363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:10.151217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:10.155403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 386/756] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:10.156496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e3f5b-7d9e-4409-b35a-eac7981628a3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.156778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e3f5b-7d9e-4409-b35a-eac7981628a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.157044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e3f5b-7d9e-4409-b35a-eac7981628a3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.158348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 387/757] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:10.159092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e3f5b-7d9e-4409-b35a-eac7981628a3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.231590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e27c1-a31c-44b5-ba10-34f45c639cc6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.270122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.270360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e3f5b-7d9e-4409-b35a-eac7981628a3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.270752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.271028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.271354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.278465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.279945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:10.291486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:10.292414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:10.293292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 371/758] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:10.294539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.313835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acda0a6-8eed-4d8c-9b46-536a03119ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.314534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acda0a6-8eed-4d8c-9b46-536a03119ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.314815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acda0a6-8eed-4d8c-9b46-536a03119ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.315088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acda0a6-8eed-4d8c-9b46-536a03119ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.317175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.327722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acda0a6-8eed-4d8c-9b46-536a03119ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.329202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acda0a6-8eed-4d8c-9b46-536a03119ea2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0acda0a6-8eed-4d8c-9b46-536a03119ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:10.343724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:10.344709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:10.351090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:10.351090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:10.351090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:10.351090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 388/759] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:10.351090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fb0c0-ca1f-4379-ad7d-ba032b2d6696 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.351090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fb0c0-ca1f-4379-ad7d-ba032b2d6696 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.351090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fb0c0-ca1f-4379-ad7d-ba032b2d6696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.368484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ea0fb0c0-ca1f-4379-ad7d-ba032b2d6696 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:10.369348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.369847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ea0fb0c0-ca1f-4379-ad7d-ba032b2d6696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:10.413105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939121-1e82-4b4d-b78e-416a91577ede None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.446207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 389/760] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:10.447290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fb0c0-ca1f-4379-ad7d-ba032b2d6696 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.456943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.457686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.458053 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.458431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.459276 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:10.459670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.461273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.479463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 372/761] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:10.480660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.567793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fb0c0-ca1f-4379-ad7d-ba032b2d6696 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.585156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.600501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4118c3-e7ed-47db-9242-85c4bda1790a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.606976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.607861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.608237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.608909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.609378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:10.609798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.611382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.626677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.628771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 390/762] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:10.629619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.639636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.640727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.641211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.641747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.642693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:10.643251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.644996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.658741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 373/763] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:10.659849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.737358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18853c1-e102-4411-825c-1609ef2a5fe3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.768917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e881b28-32f6-4c49-a33b-f5dea2fbb381 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.770543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.771141 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.771414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.771676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.772385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=5ba04cf2f81b4a33863e0789b706061e) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:10.772681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.774133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.780831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 391/764] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/role_assignments?user.id=5ba04cf2f81b4a33863e0789b706061e&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:10.781571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.818773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:10.820178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:10.820664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:10.821414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/aa4e1f12814a4923a2a37d771c59d40c/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:10.824657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=aa4e1f12814a4923a2a37d771c59d40c, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:10.827115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:10.844231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.852035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 374/765] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:24:10 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/aa4e1f12814a4923a2a37d771c59d40c/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:24:10.854161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:10.921737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:10.953125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb364e9-9ebb-40b1-bfcc-8315c93f3c92 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:10.999698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0607-889d-402a-8d15-5cf2d7312d9a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:11.011204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.012304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.012807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.013383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.022060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.024029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:11.038283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:11.039354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:11.040217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:11.040640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.040640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.040640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.040640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.040922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.041961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.043644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 392/766] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:11.058480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:11.059511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:11.060363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 375/767] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 30 00:24:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:11.062048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.065937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.178427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5f9b-f1bd-4880-a473-f41a6e03e431 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:11.188381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:11.198773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:11.203197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b04ec-6004-4578-9487-16fe07015d60 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:11.227297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3aec4-27b5-4216-9e91-baa64439f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.228305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3aec4-27b5-4216-9e91-baa64439f8fe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.228952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3aec4-27b5-4216-9e91-baa64439f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.229370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3aec4-27b5-4216-9e91-baa64439f8fe None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.230774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3aec4-27b5-4216-9e91-baa64439f8fe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:11.231218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3aec4-27b5-4216-9e91-baa64439f8fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.233463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3aec4-27b5-4216-9e91-baa64439f8fe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.239990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 376/768] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:11.241454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58dd24-dc8c-491a-bf7c-4ffc4d7f2a53 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.241886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58dd24-dc8c-491a-bf7c-4ffc4d7f2a53 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.242278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58dd24-dc8c-491a-bf7c-4ffc4d7f2a53 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.244100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 377/769] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:11.245074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58dd24-dc8c-491a-bf7c-4ffc4d7f2a53 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.246044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9675f05-6a05-4837-b218-529c1d423732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.246765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9675f05-6a05-4837-b218-529c1d423732 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.247143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9675f05-6a05-4837-b218-529c1d423732 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.247514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9675f05-6a05-4837-b218-529c1d423732 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.248314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9675f05-6a05-4837-b218-529c1d423732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:11.248941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9675f05-6a05-4837-b218-529c1d423732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.250776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9675f05-6a05-4837-b218-529c1d423732 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.268853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 393/770] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:11.268853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db21e-850f-4ad2-8864-7634c9db2a8d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.268853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db21e-850f-4ad2-8864-7634c9db2a8d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.268853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db21e-850f-4ad2-8864-7634c9db2a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.286401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b48db21e-850f-4ad2-8864-7634c9db2a8d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:11.287767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b48db21e-850f-4ad2-8864-7634c9db2a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:11.362663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 394/771] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:11.363698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48db21e-850f-4ad2-8864-7634c9db2a8d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.431459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58dd24-dc8c-491a-bf7c-4ffc4d7f2a53 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:11.477360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.478275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.478696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.479155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.479926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:11.481418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.484939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.495359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 378/772] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:11.501525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.529053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:11.541404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48db21e-850f-4ad2-8864-7634c9db2a8d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:11.583543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.586289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.586715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.587124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.588966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=41b554a0c7e14ba381185ce80cac34af) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:11.589451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.591926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.597275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:11.613739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 395/773] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/role_assignments?user.id=41b554a0c7e14ba381185ce80cac34af&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:11.640716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.747187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197123c7-ea9c-4a26-83e1-b6c1e13d6bcc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:11.803722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.804713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.805184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.805719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.806617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] RBAC: Adding query filter params (interface=public, service_id=69afb8051be04cbfa40e07df7343a027, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:11.807134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.808677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.817570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 379/774] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/endpoints?service_id=69afb8051be04cbfa40e07df7343a027&interface=public®ion_id=RegionOne => generated 194 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:11.822688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.830673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e5749-97d5-4931-bb14-5ce9b7739e0e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:11.899242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:11.899242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:11.899242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:11.899242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:11.899673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:11.899673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:11.909525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:11.910553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:11.911364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:11.914803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 396/775] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:11.921851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:11.952815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:11.968012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:11.972393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a399ba-3253-4640-9c5e-36b1fa2028bd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:12.034557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:12.035091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:12.035368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:12.035637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:12.036263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:12.037665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:12.048300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 380/776] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:12.094010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ba53-b3a3-45e0-bae6-964cf27cde93 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:12.145050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:12.145708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:12.145987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:12.146258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:12.146898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] RBAC: Adding query filter params (name=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:12.147203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:12.148667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:12.154422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 397/777] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:12.162554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:12.280269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3734a0d-8092-4abb-bc96-6f7699e15e27 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:12.315223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:12.315755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:12.316034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:12.316343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:12.317029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] RBAC: Adding query filter params (type=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:12.317331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:12.318734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:12.324086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 381/778] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:12.329788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:12.419577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:12.439307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29be130-d395-4e6d-916f-95f9fa538663 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:12.473694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d017a-f6ae-42db-8caa-b8faa86e8292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:12.474361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d017a-f6ae-42db-8caa-b8faa86e8292 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:12.474638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d017a-f6ae-42db-8caa-b8faa86e8292 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:12.474908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d017a-f6ae-42db-8caa-b8faa86e8292 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:12.475666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d017a-f6ae-42db-8caa-b8faa86e8292 None admin] RBAC: Adding query filter params (interface=public, service_id=a49c06cb41f44b8697ee30efdac888e6, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:12.475975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d017a-f6ae-42db-8caa-b8faa86e8292 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:12.477450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d017a-f6ae-42db-8caa-b8faa86e8292 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:12.485823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 398/779] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:24:12 2022] GET /identity/v3/endpoints?service_id=a49c06cb41f44b8697ee30efdac888e6&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:12.494705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:12.536287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:12.630459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43822e-dd2a-4ebc-9d51-7e4312776065 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:12.670140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb69670-d93e-420b-9dcb-08bdc8bbab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:12.670842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb69670-d93e-420b-9dcb-08bdc8bbab11 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:12.671125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb69670-d93e-420b-9dcb-08bdc8bbab11 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:12.671397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb69670-d93e-420b-9dcb-08bdc8bbab11 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:12.672010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb69670-d93e-420b-9dcb-08bdc8bbab11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:12.673370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb69670-d93e-420b-9dcb-08bdc8bbab11 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:12.679020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 382/780] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:12 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:13.055711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec352-60b4-413b-b0a3-a0c185faf551 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:13.056259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec352-60b4-413b-b0a3-a0c185faf551 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:13.056259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec352-60b4-413b-b0a3-a0c185faf551 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:13.057776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 399/781] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:13.064739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625726-0e07-4368-a971-8c1cb417ef66 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:13.065027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625726-0e07-4368-a971-8c1cb417ef66 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:13.065301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625726-0e07-4368-a971-8c1cb417ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:13.084411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b6625726-0e07-4368-a971-8c1cb417ef66 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:13.085643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b6625726-0e07-4368-a971-8c1cb417ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:13.141733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4b01-59f2-4d2c-93f1-5e725112e704 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:13.142072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4b01-59f2-4d2c-93f1-5e725112e704 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:13.142274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca4b01-59f2-4d2c-93f1-5e725112e704 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:13.143874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 400/782] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:13.150202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0591b9-6a20-4867-bde9-afe72e017da4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:13.150478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0591b9-6a20-4867-bde9-afe72e017da4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:13.150744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0591b9-6a20-4867-bde9-afe72e017da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:13.171175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 383/783] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:13.172037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7e0591b9-6a20-4867-bde9-afe72e017da4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:13.173267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e0591b9-6a20-4867-bde9-afe72e017da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:13.274456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 401/784] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:13.463260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625726-0e07-4368-a971-8c1cb417ef66 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:13.490963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:13.583925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0591b9-6a20-4867-bde9-afe72e017da4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:13.585958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625726-0e07-4368-a971-8c1cb417ef66 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:13.670023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:13.674467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:13.675140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:13.675423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:13.675698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:13.691536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0591b9-6a20-4867-bde9-afe72e017da4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:13.706443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:13.711319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:13.712227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:13.713087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:13.713742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 384/785] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:13.729507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:13.735937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:13.736866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:13.737340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:13.737826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:13.748878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:13.754307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:13.755197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:13.756022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:13.758757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 402/786] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:13.764606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:13.866942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5a5f5-81fd-4101-83b1-3ad578388d40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:13.896831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:13.903642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:13.904615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:13.905234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:13.905724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:13.906609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:13.907108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:13.908745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:13.911682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:13.918568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 403/787] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:13.924507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:13.931574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0143dc2-9336-4bf2-a726-e903c08ac693 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.001477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d41ec-2f1c-403e-9e25-03d61f37c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.002122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d41ec-2f1c-403e-9e25-03d61f37c620 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.002398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d41ec-2f1c-403e-9e25-03d61f37c620 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.002682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d41ec-2f1c-403e-9e25-03d61f37c620 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.003648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d41ec-2f1c-403e-9e25-03d61f37c620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:14.003949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d41ec-2f1c-403e-9e25-03d61f37c620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:14.005312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d41ec-2f1c-403e-9e25-03d61f37c620 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:14.017580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 385/788] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:14.017580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bdb15-598f-4445-ae50-07689fcff78f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.017580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bdb15-598f-4445-ae50-07689fcff78f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.017580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bdb15-598f-4445-ae50-07689fcff78f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.021049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 386/789] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:14.022320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c974a-2356-449a-be0e-e5f5ccda8a66 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.022602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c974a-2356-449a-be0e-e5f5ccda8a66 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.022877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c974a-2356-449a-be0e-e5f5ccda8a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.041251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-510c974a-2356-449a-be0e-e5f5ccda8a66 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:14.042489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-510c974a-2356-449a-be0e-e5f5ccda8a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:14.043249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90baf4e-e321-44b7-b4b5-836d5c98506a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.089019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.090299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.090577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.090846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.105795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:14.108125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:14.125907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 387/790] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:14.126906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c974a-2356-449a-be0e-e5f5ccda8a66 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:14.127752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:14.129098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:14.130029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:14.130029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:14.130029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:14.133135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 404/791] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:14.139770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.203354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:14.256747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138138f-1cbc-4a57-a228-36a9dc51c62c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.288732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:14.300402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.301367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.302577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.303067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.304132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:14.306041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:14.307624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:14.335507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 405/792] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:14.343082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.354934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c974a-2356-449a-be0e-e5f5ccda8a66 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.391817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.391817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.391817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.391817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.406222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:14.406222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:14.431838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:14.432838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:14.433740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:14.433740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:14.433740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:14.439790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 388/793] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:14.440690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.502779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794e400-5e56-4410-bc0f-d34ef42d70ad None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.517904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:14.539449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.540086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.540368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.540646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.549044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:14.550542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:14.562597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:14.563584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:14.564506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 406/794] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:14.565079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.587041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935864-c0c8-4634-87e9-dbe5c1f6ecf7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.615460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:14.625301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.625965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.626242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.626514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.627169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:14.627490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:14.629150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:14.641126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 389/795] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:14.641982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.682038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab4cc2-8209-469f-990f-a0e352c703f8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.717458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b443a8-9b1b-40de-b42d-85f9822d5a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.718119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b443a8-9b1b-40de-b42d-85f9822d5a19 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.718399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b443a8-9b1b-40de-b42d-85f9822d5a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.718668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b443a8-9b1b-40de-b42d-85f9822d5a19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.729056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b443a8-9b1b-40de-b42d-85f9822d5a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d8b443a8-9b1b-40de-b42d-85f9822d5a19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:14.734406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:14.735336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:14.736184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 407/796] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:14.736874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8148-4e80-4287-a753-c62cf7caeaf4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.736941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8148-4e80-4287-a753-c62cf7caeaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.737670 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc8148-4e80-4287-a753-c62cf7caeaf4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.738597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 408/797] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:14.739127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc8148-4e80-4287-a753-c62cf7caeaf4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.756524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efe00f-91ce-44dd-9c9e-cc70bfba72af None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:14.774370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:14.795776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd38aa-e269-4ec9-96f9-7a4ae0ad3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:14.796495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd38aa-e269-4ec9-96f9-7a4ae0ad3392 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.796774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd38aa-e269-4ec9-96f9-7a4ae0ad3392 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.797044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd38aa-e269-4ec9-96f9-7a4ae0ad3392 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.797803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd38aa-e269-4ec9-96f9-7a4ae0ad3392 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:14.798106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd38aa-e269-4ec9-96f9-7a4ae0ad3392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:14.799644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd38aa-e269-4ec9-96f9-7a4ae0ad3392 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:14.823505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 390/798] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:14.823505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942921b-376f-4f0e-ba9e-880251a5c56b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:14.823505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942921b-376f-4f0e-ba9e-880251a5c56b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:14.823505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942921b-376f-4f0e-ba9e-880251a5c56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:14.841204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6942921b-376f-4f0e-ba9e-880251a5c56b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:14.842540 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6942921b-376f-4f0e-ba9e-880251a5c56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:14.890326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:14.925581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 391/799] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:14.925581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942921b-376f-4f0e-ba9e-880251a5c56b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:14.965470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc8148-4e80-4287-a753-c62cf7caeaf4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.004947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.005595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.005931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.006206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.013779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.015250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:15.029279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:15.030439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:15.031598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 409/800] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:15.032434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.066553 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942921b-376f-4f0e-ba9e-880251a5c56b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.113384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.114864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.115292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.115743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.116962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:15.117688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.119551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.130039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.130526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 392/801] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:24:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:15.130860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.143957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955dfe2-fda2-416f-8a3d-ceb3e01c1570 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.168751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.180527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.181132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.181410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.181714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.234944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060896f7-2fcb-4be6-8b8b-cad14ed71a4d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.249227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.250713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.269194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479e35b-1d69-4504-adb2-400d45c4c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.269756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479e35b-1d69-4504-adb2-400d45c4c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.270034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479e35b-1d69-4504-adb2-400d45c4c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.270320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479e35b-1d69-4504-adb2-400d45c4c1f2 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.271028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479e35b-1d69-4504-adb2-400d45c4c1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:15.271329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479e35b-1d69-4504-adb2-400d45c4c1f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.272732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479e35b-1d69-4504-adb2-400d45c4c1f2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.290165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 393/802] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:15.291384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a42c45-d0a7-4da3-a08e-6d8a4b4fa27d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.291669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a42c45-d0a7-4da3-a08e-6d8a4b4fa27d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.291937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a42c45-d0a7-4da3-a08e-6d8a4b4fa27d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.293246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 394/803] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:15.294038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a42c45-d0a7-4da3-a08e-6d8a4b4fa27d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.342523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.352931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 410/804] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:15.353770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.394210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.402355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a42c45-d0a7-4da3-a08e-6d8a4b4fa27d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.448361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.448989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.449265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.449533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.457393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef4e14-ad49-4645-a24c-2204f2fa8d8a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.459949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.461389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:15.476063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:15.477027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:15.478029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:15.478029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:15.478029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:15.478029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 395/805] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:15.478029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.496588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef383fa2-3d2c-445c-bcac-d228c7547d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.497208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383fa2-3d2c-445c-bcac-d228c7547d7f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.497487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383fa2-3d2c-445c-bcac-d228c7547d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.497777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383fa2-3d2c-445c-bcac-d228c7547d7f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.498389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383fa2-3d2c-445c-bcac-d228c7547d7f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.499755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef383fa2-3d2c-445c-bcac-d228c7547d7f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ef383fa2-3d2c-445c-bcac-d228c7547d7f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:15.508775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:15.509751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:15.510585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 411/806] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:15.511353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced586-0cbf-4845-9cfb-ab2b5cd8e0f0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.511353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced586-0cbf-4845-9cfb-ab2b5cd8e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.511634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced586-0cbf-4845-9cfb-ab2b5cd8e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.529321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-32ced586-0cbf-4845-9cfb-ab2b5cd8e0f0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:15.530460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-32ced586-0cbf-4845-9cfb-ab2b5cd8e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:15.580038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.582443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf97f-3215-4c67-acc5-f5a98cfa0b64 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.598430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 412/807] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:15.599248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced586-0cbf-4845-9cfb-ab2b5cd8e0f0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.629041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.629727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.629992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.630264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.642898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.644783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.652336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:15.662917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:15.663876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:15.664767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:15.664767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:15.664767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:15.664767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 396/808] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:15.664985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.712747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced586-0cbf-4845-9cfb-ab2b5cd8e0f0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.747205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.748097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.748614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.748960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.759429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.760954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.770177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca14d5c-ce80-488e-8af2-04e241ca3dd6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:15.775835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:15.776855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:15.782953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:15.782953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:15.782953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:15.782953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 413/809] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:15.782953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.817342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.817998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.818249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.818384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.818517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.819322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:15.819441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.820839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.832913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 397/810] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:15.838376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.893823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee240a1d-d91b-4973-a467-80951ca48b24 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.896415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:15.927829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.928429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.928710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.928975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.929635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:15.929932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.931293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.936447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 414/811] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:15.937427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:15.943206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9577-68fd-4ffe-a3d5-e24a2fd92f19 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:15.977341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:15.978055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:15.978329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:15.978595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:15.979223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:15.979520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:15.981052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:15.992212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 398/812] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:15.993008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.032879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.036281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d159-8e25-42e6-a300-cba05ad65981 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.071436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.072036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.072311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.072583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.073221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:16.073519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.074905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.086357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 415/813] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:16.087147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.092470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52de5d-9a8b-4b76-b0ec-6b9cc4027f79 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.109463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.126728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.127425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.127704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.128313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.136617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.138077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:16.149046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:16.150156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:16.151068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 399/814] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:24:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:16.151662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.191996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0cf52-ecba-43eb-aa41-3d22ab95f517 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.224691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.225318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.225621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.225893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.226513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.227869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:16.237032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:16.238110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:16.238925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 416/815] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:16.242353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.249556 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633874d-f2d7-4ff2-9c6a-1968aa06731b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.267068 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.283058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.283767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.284104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.284428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.285164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:16.285463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.286903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.291618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 400/816] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:16.292217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.336212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.344440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a52f3-d969-4dc9-8a4d-5b319720ad89 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.378209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.378946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.379125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.379364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.386943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.388397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.396027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2fe17-2a73-4416-8e40-d7cc45491057 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:16.400678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:16.401696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:16.402812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:16.403460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 417/817] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:16.404258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.430522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.431151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.431428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.431697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.438463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.439904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:16.451196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:16.452318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:16.453207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 401/818] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:16.453726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.494105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.510534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7500-76aa-43e7-928f-1f4c1a25de40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.543391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.543920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.544189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.544455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.545218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:16.545523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.546984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.555698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ac4d0-35ce-47de-b6cf-c632f41e3d0b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.557215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.564467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 418/819] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:16.565246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.591744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.592397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.592672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.592941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.593578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:16.593893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.595253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.599616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 402/820] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:16.600383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.671719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99951-ede2-46ef-b786-5676df96ae9d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.705974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.706169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e422a-19ca-4f65-94b5-0dec7bc4e2f9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.706702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.706931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.707193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.707843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.709193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.728222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.745619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 419/821] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:16.745619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.761267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.762020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.762500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.762799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.763863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:16.764308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.765933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.784911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 403/822] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:16.784911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.810410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:16.862084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42024a-558e-496f-8ed1-5188cd7087e9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.905299 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71d91-f4f5-46b3-81f0-5dec87af8e5f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:16.910355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.910975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.911252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.911519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.912618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:16.912939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.914447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.927710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 420/823] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:16.928625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.941801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:16.942440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:16.942718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:16.943086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:16.954670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:16.956205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:16.971707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:16.972893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:16.973931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:16.973931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:16.973931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:16.973931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 404/824] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:16.974554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:16.995148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:17.039802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab1d83-ad15-42de-b3ea-03565fa03543 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.053914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:17.076251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.076922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.077269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.077636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.078320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] RBAC: Adding query filter params (type=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:17.078679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.080123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.085406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbadf8-70d6-42d7-86d1-fe689e60da8c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.090767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 421/825] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:17.090767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:17.131500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.132282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.132628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.132962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/5ba04cf2f81b4a33863e0789b706061e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.135145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=5ba04cf2f81b4a33863e0789b706061e, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.136949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.157807 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 405/826] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:24:16 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/5ba04cf2f81b4a33863e0789b706061e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:24:17.157807 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:17.232916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae989a-f0ad-4bf1-aab1-2339b209c59c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.261153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:17.276904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.277687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.277970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.278242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.279622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=aa4e1f12814a4923a2a37d771c59d40c) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:17.279933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.281767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.291736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 422/827] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:17 2022] GET /identity/v3/role_assignments?user.id=aa4e1f12814a4923a2a37d771c59d40c&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:17.292606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:17.298584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe8d6-6a12-4ded-bc56-e969e37ad338 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.342271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.343169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.343620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.344026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.344837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:17.345278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.346877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.349038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:17.369657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 406/828] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:17.372471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:17.435807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d15e8-9f38-4614-883c-f9988234e14d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.483617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.484496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.484779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.485050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.485774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.487420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.510374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343251e-60a6-4ad1-a8ca-ed053b1edd37 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.520235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 423/829] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:17.558012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.558661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.558937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.559206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.567374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.568995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:17.582506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:17.583486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:17.584375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:17.586548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 407/830] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:17.590150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:17.640647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:17.710816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edbee0-367c-4b8f-a168-629d461b1371 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.746573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f68fb5-1347-4cf5-9ec3-8582f7e25fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.747172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f68fb5-1347-4cf5-9ec3-8582f7e25fdc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.747449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f68fb5-1347-4cf5-9ec3-8582f7e25fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.747715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f68fb5-1347-4cf5-9ec3-8582f7e25fdc None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.748437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f68fb5-1347-4cf5-9ec3-8582f7e25fdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:17.748741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f68fb5-1347-4cf5-9ec3-8582f7e25fdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.750206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f68fb5-1347-4cf5-9ec3-8582f7e25fdc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.768294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 424/831] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:17.769798 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:17.827726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:17.883272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b808c-b8bd-4926-b537-4a4c995d03ef None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:17.919052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414bec3-7e9a-4b0b-8d60-c78c12e696e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:17.919634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414bec3-7e9a-4b0b-8d60-c78c12e696e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:17.919911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414bec3-7e9a-4b0b-8d60-c78c12e696e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:17.920243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414bec3-7e9a-4b0b-8d60-c78c12e696e4 None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/41b554a0c7e14ba381185ce80cac34af/roles/fd92aa943af04a3c8616b3cb3138ece2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:17.936479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414bec3-7e9a-4b0b-8d60-c78c12e696e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=41b554a0c7e14ba381185ce80cac34af, role_id=fd92aa943af04a3c8616b3cb3138ece2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:17.937960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414bec3-7e9a-4b0b-8d60-c78c12e696e4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:17.957838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 408/832] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:24:17 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/41b554a0c7e14ba381185ce80cac34af/roles/fd92aa943af04a3c8616b3cb3138ece2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:24:18.822113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca1f6f-bd76-4f98-9347-2fd8f8e9c290 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:18.823139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca1f6f-bd76-4f98-9347-2fd8f8e9c290 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:18.823645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca1f6f-bd76-4f98-9347-2fd8f8e9c290 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:18.825450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 425/833] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:18.830971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd607a8-d659-4a03-9de9-64d23a80f208 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:18.831777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd607a8-d659-4a03-9de9-64d23a80f208 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:18.832261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd607a8-d659-4a03-9de9-64d23a80f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:18.851191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6fd607a8-d659-4a03-9de9-64d23a80f208 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:18.852727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6fd607a8-d659-4a03-9de9-64d23a80f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:18.925931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 409/834] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:19.217779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca1f6f-bd76-4f98-9347-2fd8f8e9c290 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:19.256674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada43e-ffae-4404-843c-9964ac933b19 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.257030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada43e-ffae-4404-843c-9964ac933b19 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.257224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada43e-ffae-4404-843c-9964ac933b19 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.258828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 410/835] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:19.263920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2373-931a-4ca0-8ebe-c1c67e4b3bef None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.264209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2373-931a-4ca0-8ebe-c1c67e4b3bef None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.264487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2373-931a-4ca0-8ebe-c1c67e4b3bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.282550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e49f2373-931a-4ca0-8ebe-c1c67e4b3bef None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:19.283738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e49f2373-931a-4ca0-8ebe-c1c67e4b3bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:19.313174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:19.331607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca1f6f-bd76-4f98-9347-2fd8f8e9c290 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:19.333511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:19.370671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8650058-8bb5-4c99-937c-78c50e178522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:19.371454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650058-8bb5-4c99-937c-78c50e178522 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.371834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650058-8bb5-4c99-937c-78c50e178522 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.372199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8650058-8bb5-4c99-937c-78c50e178522 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.372893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8650058-8bb5-4c99-937c-78c50e178522 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:19.381754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8650058-8bb5-4c99-937c-78c50e178522 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:19.381908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 411/836] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c8650058-8bb5-4c99-937c-78c50e178522 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:19.396529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:19.397560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:19.398416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 426/837] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:19.403828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f2373-931a-4ca0-8ebe-c1c67e4b3bef None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:19.506998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9928-b231-40eb-b5a3-ede96d0b0b21 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.507300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9928-b231-40eb-b5a3-ede96d0b0b21 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.507471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e9928-b231-40eb-b5a3-ede96d0b0b21 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.508638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f2373-931a-4ca0-8ebe-c1c67e4b3bef None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:19.509071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 427/838] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:19.517901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13923832-7842-40b8-9c2c-d1605b2176ed None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.518181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13923832-7842-40b8-9c2c-d1605b2176ed None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.518444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13923832-7842-40b8-9c2c-d1605b2176ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.540009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-13923832-7842-40b8-9c2c-d1605b2176ed None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:19.541358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-13923832-7842-40b8-9c2c-d1605b2176ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:19.556676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:19.557443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.557875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.558145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.558782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:19.559327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:19.561247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:19.567687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 412/839] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:19.572432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:19.613921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:19.637654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 428/840] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:19.658560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13923832-7842-40b8-9c2c-d1605b2176ed None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:19.689770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d662-1289-4dc7-8d38-831aedd39835 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:19.734601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:19.735242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.735520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.735788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.736417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:19.736714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:19.738109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:19.744749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 413/841] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:19.766032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:19.773203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13923832-7842-40b8-9c2c-d1605b2176ed None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:19.814543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:19.815799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:19.816335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:19.816815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:19.832365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:19.839394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:19.840385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:19.841409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:19.844176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 429/842] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:19.851099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:19.918722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:19.956057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:19.970221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf05bff-409b-42c7-aa02-76b7f85685a5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.007482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72967-11b4-4a05-82be-f9970c06885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.008190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72967-11b4-4a05-82be-f9970c06885e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.008530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72967-11b4-4a05-82be-f9970c06885e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.008867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72967-11b4-4a05-82be-f9970c06885e None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.009617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72967-11b4-4a05-82be-f9970c06885e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:20.010004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72967-11b4-4a05-82be-f9970c06885e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.011446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c72967-11b4-4a05-82be-f9970c06885e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.025156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 414/843] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:20.025156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2cd2-b869-4190-a67c-fe47318b385b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.025156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2cd2-b869-4190-a67c-fe47318b385b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.025156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be2cd2-b869-4190-a67c-fe47318b385b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.025156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 415/844] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:20.028289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43134ab0-950d-4717-96a6-4e70536f68ce None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.028599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be2cd2-b869-4190-a67c-fe47318b385b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.064455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdfb57-f500-4cec-b2d8-d671f6c75a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.065091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdfb57-f500-4cec-b2d8-d671f6c75a5d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.065367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdfb57-f500-4cec-b2d8-d671f6c75a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.065663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdfb57-f500-4cec-b2d8-d671f6c75a5d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.066248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdfb57-f500-4cec-b2d8-d671f6c75a5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.067621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdfb57-f500-4cec-b2d8-d671f6c75a5d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-defdfb57-f500-4cec-b2d8-d671f6c75a5d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:20.076640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:20.077671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:20.078568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:20.082890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 430/845] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 30 00:24:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:20.084155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf820b-1c2c-4fca-840e-bd20ec4e5916 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.084436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf820b-1c2c-4fca-840e-bd20ec4e5916 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.084704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf820b-1c2c-4fca-840e-bd20ec4e5916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.102995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-81bf820b-1c2c-4fca-840e-bd20ec4e5916 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:20.104688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-81bf820b-1c2c-4fca-840e-bd20ec4e5916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:20.119922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:20.138169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be2cd2-b869-4190-a67c-fe47318b385b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.173697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.174332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.174619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.174925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.185957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 431/846] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:20.185957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf820b-1c2c-4fca-840e-bd20ec4e5916 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.186196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.187222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:20.204591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:20.205603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:20.207879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:20.207879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:20.207879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:20.207879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 416/847] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:20.212764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.216477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:20.306323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf820b-1c2c-4fca-840e-bd20ec4e5916 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.320881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc93d-78c2-4655-bd0a-7f84278ef9fd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.347624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.348322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.348928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.349265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.350465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:20.350889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.352892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.357962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.358498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 432/848] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:20.363128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.363413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.363685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.363795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.364339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:20.364641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.366154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.383888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 417/849] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:20.385460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:20.390067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.455036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:20.495628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e62f18-7a70-475f-be92-b6cf2663ac80 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.496988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95469ee1-a2af-4e57-8cf9-4d2a72705964 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.531956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.532567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.532845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.533116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.533778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:20.534059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.534175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.534953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.535407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.535526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.536012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.539972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 433/850] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:20.540744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.551377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.553196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:20.566994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:20.567984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:24:20.568947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:20.571199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 418/851] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:20.585610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.646287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:20.673999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86bce6-0ae6-42ee-b553-bef4ee5494df None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.688622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348d710-1769-42e8-aef4-f30aa41737ad None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.711588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.713739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.713739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.713739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.714067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:20.726118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:20.728302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.728926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.729202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.729469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.730241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:20.730542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:20.731198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:20.732080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:24:20.733009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:20.733661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.733733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 434/852] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:20.740388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.760140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 419/853] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:20.768545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.856510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303ec2-0f7f-433c-b0f0-5ff77363393c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.897016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.898266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.899122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.899846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.900731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:20.901232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:20.901476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b839f67-b988-43bc-812e-e57d29ed375c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:20.903741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:20.910591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:20.915823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 435/854] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:20.920909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:20.943974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:20.944986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:20.945426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:20.945881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:20.998605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.022774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.024620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.042137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f611ca-d16d-4b17-8ce0-8e82a9fefbd7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.084332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.085506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.086189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.086632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.100083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.102742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:21.122616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:21.123814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:21.124889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:21.124889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:21.124889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:21.127397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 436/855] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:21.133050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.153575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 420/856] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:24:21.155114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.186831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.235067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14114882-10fd-4197-be0b-aac0451e5189 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.246152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.270135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.270746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.271027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.271299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.271865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8756a5-dd1d-4f74-955c-7a9756692c50 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.271993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:21.272229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.273635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.289996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 437/857] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:21.291991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.311852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.312714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.313162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.313591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.324917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.326612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:21.342539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:21.343877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:21.345011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:21.345011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:21.345011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:21.351358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 421/858] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:21.353079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.398597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed36cd1-1f4c-4355-b161-614430b5f92b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.412405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.434137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.434830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.435120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.435386 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.442850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.444303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:21.456302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:21.457310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:21.458284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:21.462203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 438/859] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:21.463209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.498321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829b0c-15eb-4571-861a-6349a347a986 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.531530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.538985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.539872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.540486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.540950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.541814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:21.542454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.544456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.562726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 422/860] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:21.564474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.569978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5357ad-85c8-40fc-8c45-745cd10aae0a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.605701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.606314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.606643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.606916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.607705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:21.608010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.609656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.628368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 439/861] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:21.634106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.665707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.680873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21540df-f9bb-4d9e-bbcc-417e01f0ea3e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.720440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323a51-1f5d-42ef-a253-c5e01905b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.721533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323a51-1f5d-42ef-a253-c5e01905b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.722027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323a51-1f5d-42ef-a253-c5e01905b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.722527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323a51-1f5d-42ef-a253-c5e01905b2e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.730216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323a51-1f5d-42ef-a253-c5e01905b2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.732129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323a51-1f5d-42ef-a253-c5e01905b2e9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.740471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d5fef-a156-4cd5-bfca-2e9dfc035961 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-87323a51-1f5d-42ef-a253-c5e01905b2e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:21.745317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:21.746216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:21.747182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:21.749580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 423/862] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:21.753221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db451ac-aa46-4200-9346-74330c4046f8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.753221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db451ac-aa46-4200-9346-74330c4046f8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.753221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db451ac-aa46-4200-9346-74330c4046f8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.753221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 424/863] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:21.753221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db451ac-aa46-4200-9346-74330c4046f8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:21.781275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.781914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.782169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.782434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.813861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.856089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.857526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.870475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db451ac-aa46-4200-9346-74330c4046f8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:21.887219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:21.908853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cda447-3241-4fc2-850f-46c88c7bd5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:21.909537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cda447-3241-4fc2-850f-46c88c7bd5fb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.909891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cda447-3241-4fc2-850f-46c88c7bd5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.910208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cda447-3241-4fc2-850f-46c88c7bd5fb None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.910979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cda447-3241-4fc2-850f-46c88c7bd5fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:21.911275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cda447-3241-4fc2-850f-46c88c7bd5fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:21.912689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cda447-3241-4fc2-850f-46c88c7bd5fb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:21.929670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 425/864] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:21.929670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4750-c788-486a-b64c-642793c695d4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:21.929670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4750-c788-486a-b64c-642793c695d4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:21.929670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4750-c788-486a-b64c-642793c695d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:21.949232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b81c4750-c788-486a-b64c-642793c695d4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:21.950444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b81c4750-c788-486a-b64c-642793c695d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:21.965501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 440/865] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:24:21.965501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.032809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 426/866] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:22.033919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4750-c788-486a-b64c-642793c695d4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.081471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:22.084204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bc366-d651-4e7d-b5c4-4a0bc8ace142 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:22.116137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:22.123720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:22.124574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.125089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.125614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.126565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=5ba04cf2f81b4a33863e0789b706061e) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:22.127073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:22.129246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:22.142099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 441/867] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:21 2022] GET /identity/v3/role_assignments?user.id=5ba04cf2f81b4a33863e0789b706061e&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:22.148774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4750-c788-486a-b64c-642793c695d4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:22.187993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:22.188571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.188849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.189115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.201154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:22.202740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:22.219155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:22.220168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:22.221060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:22.221060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:22.221060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:22.221060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 427/868] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:22.227549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.304551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.344741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecdcb7-0acd-45b4-b144-c48b00854302 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:22.385364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:22.386369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.386874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.387345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.388203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:22.388569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:22.390128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:22.404307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 442/869] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:22.409817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.432286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:22.441917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b087182-7ee7-4164-a189-505976fc5bc2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:22.480109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0f461-7b69-4a9b-89c8-7b4962bdbab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:22.481193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0f461-7b69-4a9b-89c8-7b4962bdbab8 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.481561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0f461-7b69-4a9b-89c8-7b4962bdbab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.481924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0f461-7b69-4a9b-89c8-7b4962bdbab8 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.482839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0f461-7b69-4a9b-89c8-7b4962bdbab8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:22.483364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:22.484334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0f461-7b69-4a9b-89c8-7b4962bdbab8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:22.506458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 428/870] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:22 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:22.515055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd294-b341-4797-8a8d-51c5e0afbb5e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.515377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd294-b341-4797-8a8d-51c5e0afbb5e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.515606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbd294-b341-4797-8a8d-51c5e0afbb5e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.521263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 429/871] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:22.522732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4702724-dc08-4ae6-bc2d-afbf50273865 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.523015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4702724-dc08-4ae6-bc2d-afbf50273865 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.523286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4702724-dc08-4ae6-bc2d-afbf50273865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.526253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8121d3-950d-40cc-8525-9078f3b599ec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:22.542643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c4702724-dc08-4ae6-bc2d-afbf50273865 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:22.543890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c4702724-dc08-4ae6-bc2d-afbf50273865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:22.577905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:22.578895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.579262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.579538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.589476 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:22.591780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:22.606177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:22.607125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:22.608564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 443/872] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:22.613158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.629938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 430/873] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:22.738721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986b2a9-8181-4751-80ab-94dc2e9c3a59 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:22.750617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:22.776754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:22.777787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.778393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.778989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.780137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:22.780636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:22.782255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:22.796302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 444/874] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:22.801927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4702724-dc08-4ae6-bc2d-afbf50273865 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.900384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:22.914813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:22.917359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4702724-dc08-4ae6-bc2d-afbf50273865 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:22.954261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746925c-462a-4fe3-b7d9-521baf793eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:22.955236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746925c-462a-4fe3-b7d9-521baf793eed None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:22.956299 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746925c-462a-4fe3-b7d9-521baf793eed None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:22.956588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746925c-462a-4fe3-b7d9-521baf793eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:22.957339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746925c-462a-4fe3-b7d9-521baf793eed None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=41b554a0c7e14ba381185ce80cac34af) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:22.957676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746925c-462a-4fe3-b7d9-521baf793eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:22.959122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746925c-462a-4fe3-b7d9-521baf793eed None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:22.969652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 431/875] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:22 2022] GET /identity/v3/role_assignments?user.id=41b554a0c7e14ba381185ce80cac34af&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:23.037832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef204-29f6-4cb0-9033-c6cae9794187 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:23.075693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362a595-b127-44ee-b8d5-be49e405b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:23.076343 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362a595-b127-44ee-b8d5-be49e405b299 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:23.076652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362a595-b127-44ee-b8d5-be49e405b299 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:23.076938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362a595-b127-44ee-b8d5-be49e405b299 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:23.077628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362a595-b127-44ee-b8d5-be49e405b299 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:23.079029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362a595-b127-44ee-b8d5-be49e405b299 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:23.099552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 445/876] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:22 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:24:24.236783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23dfc-b547-4f36-8c56-5905eda5c955 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:24.237319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23dfc-b547-4f36-8c56-5905eda5c955 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:24.237428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a23dfc-b547-4f36-8c56-5905eda5c955 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:24.239264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 432/877] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:24.244824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123ac5b-171a-43e8-93ea-1cef5565360c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:24.245267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123ac5b-171a-43e8-93ea-1cef5565360c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:24.245459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123ac5b-171a-43e8-93ea-1cef5565360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:24.264521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e123ac5b-171a-43e8-93ea-1cef5565360c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:24.269635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e123ac5b-171a-43e8-93ea-1cef5565360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:24.290535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:24.341150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 446/878] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:24.484455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f8e04-1a16-414c-9248-11c35b38c83a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:24.484898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f8e04-1a16-414c-9248-11c35b38c83a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:24.485266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f8e04-1a16-414c-9248-11c35b38c83a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:24.487029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 433/879] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:24.492241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e7502-feb7-44bd-84d6-c8a16766a523 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:24.492525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e7502-feb7-44bd-84d6-c8a16766a523 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:24.492795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e7502-feb7-44bd-84d6-c8a16766a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:24.511821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fe4e7502-feb7-44bd-84d6-c8a16766a523 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:24.513008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fe4e7502-feb7-44bd-84d6-c8a16766a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:24.582947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 447/880] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:24.620655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f8e04-1a16-414c-9248-11c35b38c83a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:24.731558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f8e04-1a16-414c-9248-11c35b38c83a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:24.767293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:24.767844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:24.768120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:24.768388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:24.768973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:24.770360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:24.779502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:24.781420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:24.783392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 434/881] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:24.792090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e7502-feb7-44bd-84d6-c8a16766a523 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:24.854619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:24.870916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:24.885995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:24.900584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e7502-feb7-44bd-84d6-c8a16766a523 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:24.936247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:24.937001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:24.937349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:24.937721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:24.938469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:24.938842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:24.940282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:24.945571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 448/882] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:24.951141 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:24.977385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9151-30f9-430f-b223-00330b5b419b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.013507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262dac-4d27-4897-b922-79caf6c0fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.014439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262dac-4d27-4897-b922-79caf6c0fb26 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.014912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262dac-4d27-4897-b922-79caf6c0fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.015193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262dac-4d27-4897-b922-79caf6c0fb26 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.015781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262dac-4d27-4897-b922-79caf6c0fb26 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.017176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262dac-4d27-4897-b922-79caf6c0fb26 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4d262dac-4d27-4897-b922-79caf6c0fb26 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:25.026278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:25.027418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:25.028511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:25.032347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 435/883] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:25.033665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779aff1-f9f5-4c4c-88e9-ace3e92cdf12 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.033949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779aff1-f9f5-4c4c-88e9-ace3e92cdf12 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.034228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779aff1-f9f5-4c4c-88e9-ace3e92cdf12 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.035510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 436/884] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:25.036193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779aff1-f9f5-4c4c-88e9-ace3e92cdf12 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.072171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa542-df38-4ef2-8645-8140acd59829 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.105512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf417023-44ac-4979-8b40-636184e1ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.106134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417023-44ac-4979-8b40-636184e1ab39 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.106406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417023-44ac-4979-8b40-636184e1ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.106674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf417023-44ac-4979-8b40-636184e1ab39 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.107290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf417023-44ac-4979-8b40-636184e1ab39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:25.107612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf417023-44ac-4979-8b40-636184e1ab39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.108969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf417023-44ac-4979-8b40-636184e1ab39 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.113301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 449/885] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:25.114529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee456e-d52d-42d9-8f0b-7a817c8e37c1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.114808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee456e-d52d-42d9-8f0b-7a817c8e37c1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.115077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee456e-d52d-42d9-8f0b-7a817c8e37c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.121097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:25.140265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-86ee456e-d52d-42d9-8f0b-7a817c8e37c1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:25.141809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-86ee456e-d52d-42d9-8f0b-7a817c8e37c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:25.149390 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779aff1-f9f5-4c4c-88e9-ace3e92cdf12 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.152758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:25.188636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8aa7a-b6d9-469a-a090-43c6afc0a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.189358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8aa7a-b6d9-469a-a090-43c6afc0a252 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.189732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8aa7a-b6d9-469a-a090-43c6afc0a252 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.190046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8aa7a-b6d9-469a-a090-43c6afc0a252 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.190739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8aa7a-b6d9-469a-a090-43c6afc0a252 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:25.191047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8aa7a-b6d9-469a-a090-43c6afc0a252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.192438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8aa7a-b6d9-469a-a090-43c6afc0a252 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.198252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 437/886] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:25.199557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abcb41-cdcc-488e-abd3-d00b48675524 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.199837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abcb41-cdcc-488e-abd3-d00b48675524 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.200104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abcb41-cdcc-488e-abd3-d00b48675524 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.205586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 438/887] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:25.206483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abcb41-cdcc-488e-abd3-d00b48675524 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.225416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 450/888] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:25.226986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9676003-d1e6-4b64-8026-99c7d5920338 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.227445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9676003-d1e6-4b64-8026-99c7d5920338 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.227876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9676003-d1e6-4b64-8026-99c7d5920338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.247277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e9676003-d1e6-4b64-8026-99c7d5920338 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:25.249285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9676003-d1e6-4b64-8026-99c7d5920338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:25.334805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 451/889] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:25.346382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abcb41-cdcc-488e-abd3-d00b48675524 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.393770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.394436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.394710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.394978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.395649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:25.395943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.397359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.407856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 439/890] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:25.410728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9676003-d1e6-4b64-8026-99c7d5920338 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.491120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.493626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:25.496649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:25.533349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9676003-d1e6-4b64-8026-99c7d5920338 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.570719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.571338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.571619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.571890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.572600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] RBAC: Adding query filter params (interface=public, service_id=bf60c79c8fb04d279af317fabdadede7, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:25.572905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.574321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.584501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 452/891] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/endpoints?service_id=bf60c79c8fb04d279af317fabdadede7&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:25.585869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.611507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43767b0-5c55-48d9-beab-c35d82828252 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.653676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.654468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.654750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.655022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.665458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:25.670742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:25.671685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:25.672508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 440/892] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:25.673180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.705301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa419f1a-047a-4a66-9e31-2eaae41d7ac4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.740677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.741277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.741579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.741848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.742446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.743303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:25.743812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.751241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 453/893] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:24:25.752296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.755598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:25.807450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033cec6-7eed-4964-bd48-db83a94e5551 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.858047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.859492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.859975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.860442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.861269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.863821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.876149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d28b27-bcb7-4a85-b906-3ebbc39a6cea None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:25.878572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:25.879467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:25.880338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:25.883816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 441/894] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:25.889690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:25.922424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:25.922661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:25.922755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:25.923010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:25.923687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:25.923991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:25.925581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:25.939439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 454/895] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:25.940742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.022962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dca63-aa6b-435d-8e16-c6ae19da1424 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.024246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.061912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.069003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c2d9-1ceb-4d9a-890c-efe87e52de72 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.072785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.073403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.073710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.073981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.074614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:26.074911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.076326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.085580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 442/896] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:26.089023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.112579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.113502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.114033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.114554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.126467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.128468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:26.143826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:26.144789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:26.145783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:26.145783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:26.145783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:26.145783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 455/897] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:26.152743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.208766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4523db-7b9f-487e-9e2c-e46ca9ece132 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.254124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.255001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.255279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.255546 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.256340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:26.256956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.258604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.262616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8932cf-1783-48c2-9bfe-678aa96449b6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.264827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 443/898] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:26.274501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.284051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.306629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.307291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.307574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.307844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.308487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:26.308789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.310400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.328212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 456/899] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:26.329714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.352403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.414204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd262e-4423-4ffa-953a-c82359f6cbdb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.435394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda47a-5371-4ead-a087-54604f8760e1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.452054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.452690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.452968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.453241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.454082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] RBAC: Adding query filter params (interface=public, service_id=cc0daf2ec1134c95bb6404a9bf3e9699, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:26.454392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.455855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.461764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 444/900] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/endpoints?service_id=cc0daf2ec1134c95bb6404a9bf3e9699&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:26.466784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.479115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.480441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.480968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.481727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.492371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.494595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:26.510589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:26.511563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:26.512488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:26.519485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 457/901] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:26.520942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.558264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.577496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867e68d-2523-4a66-876d-91a35857a47d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.599282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.615220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.616367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.616367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.616872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.617592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.619061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.629920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 445/902] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:24:26.630228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e18e-ab99-47e5-a45a-ba29ae659f4d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.669345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.670290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.670714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.671153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.672115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:26.672571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.674237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.699644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 458/903] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:26.701417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.822909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afcca2-a469-4f11-8e01-322fee4bcd6b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.860500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2fe88-8b43-48d1-ae8f-9acc2b683c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.861177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2fe88-8b43-48d1-ae8f-9acc2b683c93 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.861457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2fe88-8b43-48d1-ae8f-9acc2b683c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.861751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2fe88-8b43-48d1-ae8f-9acc2b683c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.915045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.931902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2fe88-8b43-48d1-ae8f-9acc2b683c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.933274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2fe88-8b43-48d1-ae8f-9acc2b683c93 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:27.036161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 446/904] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:27.041759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:27.093643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ed010-823f-4b33-832e-f8c5796c0e61 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.094009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ed010-823f-4b33-832e-f8c5796c0e61 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.094175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ed010-823f-4b33-832e-f8c5796c0e61 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.095782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 447/905] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:27.100570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e154c4-72f2-423c-ba75-55286fe92544 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.100846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e154c4-72f2-423c-ba75-55286fe92544 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.101121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e154c4-72f2-423c-ba75-55286fe92544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.119574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c3e154c4-72f2-423c-ba75-55286fe92544 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:27.120853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c3e154c4-72f2-423c-ba75-55286fe92544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:27.145332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:27.153065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383943-1411-404d-a54a-2541c99f363d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:27.194731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:27.195368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.195647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.195914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.196478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 448/906] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:27.208202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:27.209695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:27.224475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:27.225430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:27.226318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:27.226318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:27.226318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:27.230307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 459/907] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:27.231704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e154c4-72f2-423c-ba75-55286fe92544 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:27.248146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:27.339627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e154c4-72f2-423c-ba75-55286fe92544 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:27.375204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:27.376600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.377056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.377493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.378651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:27.379123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:27.380680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:27.394398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 449/908] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:27.399424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:27.486052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:27.507428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169462e9-f38d-413d-a9b6-a715f505fe66 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:27.544869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:27.545707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.546176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.547091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.556789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:27.558351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:27.570972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:27.571964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:27.573189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 460/909] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:27.579414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:27.586504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:27.589909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:27.622095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24efb76-34c4-4edc-be6f-6a6370cc607d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:27.671680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e8cb-fecd-4f4d-a3b5-7006d33d4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:27.672632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e8cb-fecd-4f4d-a3b5-7006d33d4544 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.673102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e8cb-fecd-4f4d-a3b5-7006d33d4544 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.673993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e8cb-fecd-4f4d-a3b5-7006d33d4544 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.675255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e8cb-fecd-4f4d-a3b5-7006d33d4544 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:27.677248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e8cb-fecd-4f4d-a3b5-7006d33d4544 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:27.709524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5de8d-6164-462f-aca3-64bc222c42d6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:27.709751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 450/910] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:27 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:27.729316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a3c1-51f4-4331-9899-26347c77ebc1 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.729688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a3c1-51f4-4331-9899-26347c77ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.729897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a3c1-51f4-4331-9899-26347c77ebc1 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.731736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 451/911] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:27.737379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3270-135f-4a09-8f05-94ceccfaacbf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.737589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3270-135f-4a09-8f05-94ceccfaacbf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.737854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3270-135f-4a09-8f05-94ceccfaacbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.759100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:27.759484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-161e3270-135f-4a09-8f05-94ceccfaacbf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:27.760318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:27.760728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-161e3270-135f-4a09-8f05-94ceccfaacbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:27.761033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:27.761495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:27.762470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:27.763087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:27.764856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:27.779983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 461/912] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:27.786978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:27.853980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 452/913] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:27.928241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:27.967499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed5d84-ea69-4dd7-98e2-815f31172b56 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:28.003892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:28.004470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:28.004747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:28.005009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:28.005766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] RBAC: Adding query filter params (role.id=864b56d673994ec2a8c8d6fbbeadab9b, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=41b554a0c7e14ba381185ce80cac34af) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:28.006051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:28.007484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:28.014159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 462/914] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:27 2022] GET /identity/v3/role_assignments?user.id=41b554a0c7e14ba381185ce80cac34af&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=864b56d673994ec2a8c8d6fbbeadab9b => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:28.131701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3270-135f-4a09-8f05-94ceccfaacbf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:28.198159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:28.239650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3270-135f-4a09-8f05-94ceccfaacbf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:28.279104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:28.280106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:28.280581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:28.281057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:28.282177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:28.284934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:28.295843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:28.296963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:24:28.297836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:28.300625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 453/915] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:28.306795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:28.426915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bf3e1-cdc6-449f-b823-222f48792961 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:28.454157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:28.465891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:28.466504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:28.466782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:28.467083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:28.467719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:28.468019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:28.469396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:28.474731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 463/916] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:28.480136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:28.587248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cce2b-4848-4d23-a927-03316fb2442d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:28.614256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:28.623180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63605f-a0e7-474c-ba08-1f2342869c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:28.623801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63605f-a0e7-474c-ba08-1f2342869c5f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:28.624108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63605f-a0e7-474c-ba08-1f2342869c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:28.624379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63605f-a0e7-474c-ba08-1f2342869c5f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:28.625036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63605f-a0e7-474c-ba08-1f2342869c5f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:28.625322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63605f-a0e7-474c-ba08-1f2342869c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:28.626727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63605f-a0e7-474c-ba08-1f2342869c5f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:28.632808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 454/917] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Aug 30 00:24:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:28.638464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:28.745650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e4155-516b-4a28-a308-7d8a4faf118d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:28.760202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd292-bdd7-48ef-84a5-64129d2548cd None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:28.760508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd292-bdd7-48ef-84a5-64129d2548cd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:28.760754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd292-bdd7-48ef-84a5-64129d2548cd None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:28.762392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 455/918] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:28.768058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2fca-acdb-4f0c-aca6-8244a018f4a2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:28.768337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2fca-acdb-4f0c-aca6-8244a018f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:28.768607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2fca-acdb-4f0c-aca6-8244a018f4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:28.786029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:28.786642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:28.786920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:28.787130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-931a2fca-acdb-4f0c-aca6-8244a018f4a2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:28.787230 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:28.787842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:28.788277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-931a2fca-acdb-4f0c-aca6-8244a018f4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:28.789452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:28.813291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 464/919] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:28.876280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 456/920] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:29.144062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:29.192628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:29.246337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7aba8-89d5-484a-99eb-2c7202c75dd0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:29.280485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:29.281116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:29.281397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:29.281701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:29.282287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:29.283745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:29.292533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:29.293443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:29.294346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 465/921] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Aug 30 00:24:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:29.299940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a2fca-acdb-4f0c-aca6-8244a018f4a2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:29.403275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a2fca-acdb-4f0c-aca6-8244a018f4a2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:29.421486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:29.439035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:29.439650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:29.439927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:29.440195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:29.440827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:29.441127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:29.442519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:29.447642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 457/922] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:29.453411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:29.555876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80902f-1289-45a9-9a0c-2741d61f2d27 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:29.566643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:29.599902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb91258-1a50-4e06-a362-e8ad008c31cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:29.600948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91258-1a50-4e06-a362-e8ad008c31cc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:29.601409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91258-1a50-4e06-a362-e8ad008c31cc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:29.601723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91258-1a50-4e06-a362-e8ad008c31cc None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:29.602449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb91258-1a50-4e06-a362-e8ad008c31cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:29.602751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb91258-1a50-4e06-a362-e8ad008c31cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:29.605281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb91258-1a50-4e06-a362-e8ad008c31cc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:29.612062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 466/923] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:29.617757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:29.717614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca80cde-ac92-4de9-9f03-b6a6517a2c1f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:29.752957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a27be-2415-43d7-978c-19c4011d3283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:29.753584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a27be-2415-43d7-978c-19c4011d3283 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:29.753866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a27be-2415-43d7-978c-19c4011d3283 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:29.754134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a27be-2415-43d7-978c-19c4011d3283 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:29.754808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a27be-2415-43d7-978c-19c4011d3283 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:29.756162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a27be-2415-43d7-978c-19c4011d3283 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:29.784086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 458/924] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:29.924701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25a116-aa5e-4442-88fe-acb403f53cc8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:29.925032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25a116-aa5e-4442-88fe-acb403f53cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:29.925255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25a116-aa5e-4442-88fe-acb403f53cc8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:29.926908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 467/925] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:29.932132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f178-eb03-4a03-896c-1a0f25497101 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:29.932423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f178-eb03-4a03-896c-1a0f25497101 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:29.932695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f178-eb03-4a03-896c-1a0f25497101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:29.951610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fd53f178-eb03-4a03-896c-1a0f25497101 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:29.952847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fd53f178-eb03-4a03-896c-1a0f25497101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:29.987258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:29.991169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399333f-971a-49f8-93d7-eba7174e8dbd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:29.991683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399333f-971a-49f8-93d7-eba7174e8dbd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:29.992158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399333f-971a-49f8-93d7-eba7174e8dbd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:29.995053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 468/926] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:30.003277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb56f18-445f-423a-b9a2-994936547575 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.003692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb56f18-445f-423a-b9a2-994936547575 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.004055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb56f18-445f-423a-b9a2-994936547575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.023854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8eb56f18-445f-423a-b9a2-994936547575 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:30.025142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8eb56f18-445f-423a-b9a2-994936547575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:30.040951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 459/927] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:30.097814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 469/928] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:30.310861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53f178-eb03-4a03-896c-1a0f25497101 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:30.369064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb56f18-445f-423a-b9a2-994936547575 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:30.425490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53f178-eb03-4a03-896c-1a0f25497101 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:30.469289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:30.469954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.470541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.470823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.471412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:30.473222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:30.480270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb56f18-445f-423a-b9a2-994936547575 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:30.483412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:30.484194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:30.485161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:30.486716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:30.489622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 460/929] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:30.491120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:30.522261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:30.533157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:30.533820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.534095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.534360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.548202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:30.554078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:30.554981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:30.555807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 470/930] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 30 00:24:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:30.562916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:30.611721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f0350-4128-4b53-8694-ee7274c9b41f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:30.654444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:30.655128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.655370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.655640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.656776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:30.657097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:30.658790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:30.669627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 461/931] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:30.671127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:30.677156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc0d63-c156-4cde-b1d7-950f61adb46b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:30.713501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:30.714153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.714441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.714771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.715632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:30.715742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:30.717136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:30.730200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 471/932] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 30 00:24:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:30.731256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:30.759502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:30.789955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:30.801496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d4971-2a49-42ab-a7d7-f280c3f006f3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:30.837649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07b9cf-0c64-4c56-9515-347119ea5374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:30.838231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07b9cf-0c64-4c56-9515-347119ea5374 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.838507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07b9cf-0c64-4c56-9515-347119ea5374 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.838772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07b9cf-0c64-4c56-9515-347119ea5374 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.839400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07b9cf-0c64-4c56-9515-347119ea5374 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:30.839700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07b9cf-0c64-4c56-9515-347119ea5374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:30.841058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07b9cf-0c64-4c56-9515-347119ea5374 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:30.846039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 462/933] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:30.846039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9033f4-2d35-4534-999b-b68d6a959e17 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.846039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9033f4-2d35-4534-999b-b68d6a959e17 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.846039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9033f4-2d35-4534-999b-b68d6a959e17 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.846039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 463/934] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:30.853215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952b1fa-ce78-4f96-b521-9c879b866e78 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:30.853567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9033f4-2d35-4534-999b-b68d6a959e17 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:30.890677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9dad7-5e6c-4dde-9863-6491ebe09fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:30.892104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9dad7-5e6c-4dde-9863-6491ebe09fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.892382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9dad7-5e6c-4dde-9863-6491ebe09fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.892654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9dad7-5e6c-4dde-9863-6491ebe09fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.905620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9dad7-5e6c-4dde-9863-6491ebe09fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:30.907134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9dad7-5e6c-4dde-9863-6491ebe09fa9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-67b9dad7-5e6c-4dde-9863-6491ebe09fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:30.922348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:30.923349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:30.924217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:30.924217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:30.924217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:30.926257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 472/935] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:30.927419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f13a63-1698-48bb-b4fa-00a52a121fa5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:30.927697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f13a63-1698-48bb-b4fa-00a52a121fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:30.927966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f13a63-1698-48bb-b4fa-00a52a121fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:30.945682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c9f13a63-1698-48bb-b4fa-00a52a121fa5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:30.946862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c9f13a63-1698-48bb-b4fa-00a52a121fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:30.965610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9033f4-2d35-4534-999b-b68d6a959e17 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.000446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.001026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.001306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.001592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.002292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] RBAC: Adding query filter params (interface=public, service_id=d17beeb96384404db8df02a680c18a8b, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:31.002600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.004282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.009227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 464/936] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:24:30 2022] GET /identity/v3/endpoints?service_id=d17beeb96384404db8df02a680c18a8b&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:31.013746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.029579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 473/937] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:31.029579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f13a63-1698-48bb-b4fa-00a52a121fa5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.038844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:31.040402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:31.127982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fdcb1-257c-46b5-892b-7135c18a2e5a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.160610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f13a63-1698-48bb-b4fa-00a52a121fa5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.165388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.166038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.166307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.166566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.167256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:31.167554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.168900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.186116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 465/938] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:31.187000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.199576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.200586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.201069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.201668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.202615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.204197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.211233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 474/939] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:24:31.278591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:31.300896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4824a6-cada-48ee-8aae-4d14e8acfaf9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.338432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.340115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.341042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.341515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.341912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.349998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.351607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:31.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:31.365497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:31.366768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:31.372378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 466/940] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:31.373363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.436367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:31.468903 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4de05-430a-49bb-9607-56a88f505174 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.489584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fac4-6501-413e-b65f-27211259b9aa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.506085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.507424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.508006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.508468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.509461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.511185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.514316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING keystone.server.flask.common [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 00:24:31.526090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.526782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.527121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.527455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.528255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:31.528624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.530414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.534987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.sql.core [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:24:31.534987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:24:31.534987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [parameters: {'id': '104c6282de004528ad3a2c67cda33d7c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:24:31.534987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:24:31.540606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 104c6282de004528ad3a2c67cda33d7c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 104c6282de004528ad3a2c67cda33d7c. Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:24:31.545048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 00:24:31.545946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application yield resource Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise self.value Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application session.commit() Aug 30 00:24:31.546921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:24:31.547849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:24:31.548777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:24:31.549715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [parameters: {'id': '104c6282de004528ad3a2c67cda33d7c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:31.550985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:31.557277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 104c6282de004528ad3a2c67cda33d7c. Aug 30 00:24:31.559392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.560886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 467/941] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:31.561063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 475/942] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Aug 30 00:24:31 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:31.561210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.563558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.672790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56505e-d624-4659-ad5f-4264085fefd1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.686531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb107-516c-4714-b5f9-68dfdbb0225e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.709640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.710273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.710549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.710831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.717150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:31.725491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.726957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.727458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473643b-e495-4b9a-9d0c-6afa1a084552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.728376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473643b-e495-4b9a-9d0c-6afa1a084552 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.728960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473643b-e495-4b9a-9d0c-6afa1a084552 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.729515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473643b-e495-4b9a-9d0c-6afa1a084552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.737383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473643b-e495-4b9a-9d0c-6afa1a084552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.739449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473643b-e495-4b9a-9d0c-6afa1a084552 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:31.742599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:31.743693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:31.744569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:31.744569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:31.744569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:31.748657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 468/943] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:31.749566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1473643b-e495-4b9a-9d0c-6afa1a084552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:31.755693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:31.756569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:31.757438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:31.759103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 476/944] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:31.760750 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f8875-6580-48b9-9048-e57ad247d5b8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.761038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f8875-6580-48b9-9048-e57ad247d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.765359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f8875-6580-48b9-9048-e57ad247d5b8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.766582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 477/945] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:31.768453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f8875-6580-48b9-9048-e57ad247d5b8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:31.802573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:31.855883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4118c-7ed4-42c0-b419-961af884be1e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.875730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f8875-6580-48b9-9048-e57ad247d5b8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:31.892992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c857a-9634-4609-9875-a2728ea076bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.893629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c857a-9634-4609-9875-a2728ea076bc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.893909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c857a-9634-4609-9875-a2728ea076bc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.894179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c857a-9634-4609-9875-a2728ea076bc None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.894828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c857a-9634-4609-9875-a2728ea076bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:31.895125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c857a-9634-4609-9875-a2728ea076bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.896487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c857a-9634-4609-9875-a2728ea076bc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.913149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 469/946] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:31.913149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c49aa-8cf6-4c98-9fb9-84a1e974f060 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.913149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c49aa-8cf6-4c98-9fb9-84a1e974f060 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.913149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c49aa-8cf6-4c98-9fb9-84a1e974f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.919038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:31.920295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:31.920295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:31.920471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:31.921233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:31.921580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:31.923159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:31.929944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-949c49aa-8cf6-4c98-9fb9-84a1e974f060 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:31.931144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-949c49aa-8cf6-4c98-9fb9-84a1e974f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:31.949589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 478/947] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:31.949589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:32.015853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:32.034034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 470/948] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:32.090375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60b256-ad1a-44ac-8c0c-4f8d3ccb8e89 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:32.130941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:32.131581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:32.131861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:32.132133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:32.139100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:32.140550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:32.151842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:32.152904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:32.154100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 479/949] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:32.160468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c49aa-8cf6-4c98-9fb9-84a1e974f060 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:32.209968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:32.277799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c49aa-8cf6-4c98-9fb9-84a1e974f060 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:32.315431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:32.316213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:32.316587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:32.316955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:32.317796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:32.318200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:32.319725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:32.323599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:32.336541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 471/950] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:32.344995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:32.461120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e18470-dd12-48dd-96bb-c5264e1bfdf9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:32.472103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:32.473027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:32.477324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77b4f7-410d-4b8f-9b52-f5ed483eebb1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:32.506874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:32.507539 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:32.510933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:32.510933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:32.510933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:32.510933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:32.521243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:32.522480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:32.523371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 480/951] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:32.529619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:32.529619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:32.529619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:32.529619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/41b554a0c7e14ba381185ce80cac34af/roles/864b56d673994ec2a8c8d6fbbeadab9b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:32.532429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=41b554a0c7e14ba381185ce80cac34af, role_id=864b56d673994ec2a8c8d6fbbeadab9b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:32.533903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:32.534946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:32.554096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 472/952] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:24:32 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/41b554a0c7e14ba381185ce80cac34af/roles/864b56d673994ec2a8c8d6fbbeadab9b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:24:32.652321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349c1d-e615-4312-8d3f-0dc27a6abeda None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:32.690277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4a34-9d09-44e6-ac0e-5747426df05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:32.690981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4a34-9d09-44e6-ac0e-5747426df05d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:32.691263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4a34-9d09-44e6-ac0e-5747426df05d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:32.691534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4a34-9d09-44e6-ac0e-5747426df05d None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:32.692312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4a34-9d09-44e6-ac0e-5747426df05d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:32.692620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4a34-9d09-44e6-ac0e-5747426df05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:32.694047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4a34-9d09-44e6-ac0e-5747426df05d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:32.700172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 481/953] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:32.707644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:32.828359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791bbeb-0c76-4782-86d5-f396ad8095b3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:32.866620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecfb23-1b77-4687-84c7-c0c371522f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:32.867626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecfb23-1b77-4687-84c7-c0c371522f87 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:32.868141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecfb23-1b77-4687-84c7-c0c371522f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:32.868621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecfb23-1b77-4687-84c7-c0c371522f87 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:32.869460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecfb23-1b77-4687-84c7-c0c371522f87 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:32.870167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecfb23-1b77-4687-84c7-c0c371522f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:32.871731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecfb23-1b77-4687-84c7-c0c371522f87 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:32.878414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 473/954] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:33.306125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae539-178b-48f2-b20b-3c168e349df8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:33.306834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae539-178b-48f2-b20b-3c168e349df8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:33.307328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae539-178b-48f2-b20b-3c168e349df8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:33.309196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 482/955] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:33.314879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b9fdc-d955-4f75-ac49-66cb30b614ee None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:33.315412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b9fdc-d955-4f75-ac49-66cb30b614ee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:33.315892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b9fdc-d955-4f75-ac49-66cb30b614ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:33.342788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6e0b9fdc-d955-4f75-ac49-66cb30b614ee None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:33.344352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6e0b9fdc-d955-4f75-ac49-66cb30b614ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:33.363320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:33.428050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 474/956] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:33.701898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae539-178b-48f2-b20b-3c168e349df8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:33.742037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:33.813107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae539-178b-48f2-b20b-3c168e349df8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:33.848754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:33.849900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:33.850381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:33.850851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:33.851660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:33.853233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:33.862979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:33.864106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:33.865008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:33.867892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 483/957] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:33.873648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b9fdc-d955-4f75-ac49-66cb30b614ee None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:33.979366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b9fdc-d955-4f75-ac49-66cb30b614ee None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:34.015127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee11c7-a01f-4a0b-bd1d-f4b1b6c81399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:34.015745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee11c7-a01f-4a0b-bd1d-f4b1b6c81399 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.016020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee11c7-a01f-4a0b-bd1d-f4b1b6c81399 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.016291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee11c7-a01f-4a0b-bd1d-f4b1b6c81399 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.016927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee11c7-a01f-4a0b-bd1d-f4b1b6c81399 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:34.017229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee11c7-a01f-4a0b-bd1d-f4b1b6c81399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:34.018638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee11c7-a01f-4a0b-bd1d-f4b1b6c81399 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:34.023990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 475/958] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:34.029757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:34.090302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ccda6-4e9d-41c6-99b4-87181d44c48d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.090620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ccda6-4e9d-41c6-99b4-87181d44c48d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.090849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ccda6-4e9d-41c6-99b4-87181d44c48d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.092597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 476/959] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:34.101041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b3904-77dd-4d2d-8335-62dfb6471ef8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.101323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b3904-77dd-4d2d-8335-62dfb6471ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.101619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b3904-77dd-4d2d-8335-62dfb6471ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.120533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c33b3904-77dd-4d2d-8335-62dfb6471ef8 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:34.121900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c33b3904-77dd-4d2d-8335-62dfb6471ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:34.136956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:34.141256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:34.145392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d1243-7d4a-42ab-95e9-49e58263fa90 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:34.183216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:34.183956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.184375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.184799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.185527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:34.185952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:34.187700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:34.193585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 484/960] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:34.200733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:34.209569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 477/961] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:34.316729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb014a36-3e84-4c4d-9a31-5499a0980aa4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:34.353984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d307bb4-c83c-47e8-9e14-5e65eb4412bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:34.354597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307bb4-c83c-47e8-9e14-5e65eb4412bd None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.354878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307bb4-c83c-47e8-9e14-5e65eb4412bd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.355148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d307bb4-c83c-47e8-9e14-5e65eb4412bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.355823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307bb4-c83c-47e8-9e14-5e65eb4412bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:34.357192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d307bb4-c83c-47e8-9e14-5e65eb4412bd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:34.392602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 485/962] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:34.476208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b3904-77dd-4d2d-8335-62dfb6471ef8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:34.520671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb535-a73d-4d41-9a24-cf71119eaf1e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.521033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb535-a73d-4d41-9a24-cf71119eaf1e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.521299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb535-a73d-4d41-9a24-cf71119eaf1e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.523032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 486/963] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:34.528370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ebe6-e7df-49fc-9b8d-fa78d0a45a52 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.528648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ebe6-e7df-49fc-9b8d-fa78d0a45a52 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.528922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ebe6-e7df-49fc-9b8d-fa78d0a45a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.548867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0512ebe6-e7df-49fc-9b8d-fa78d0a45a52 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:34.550511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0512ebe6-e7df-49fc-9b8d-fa78d0a45a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:34.567285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:34.591619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b3904-77dd-4d2d-8335-62dfb6471ef8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:34.637991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:34.638618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.638895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.639158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.639781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:34.641303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:34.641715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 487/964] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:34.647584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING keystone.server.flask.common [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 00:24:34.661568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.sql.core [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:24:34.661568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:24:34.661568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [parameters: {'user_id': 'f64f3e6939a648d49257c919c1c2f8ce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:24:34.661568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c3137bea-14b7-453b-8ee9-91ceac225e36 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Aug 30 00:24:34.678571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:24:34.679539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application yield resource Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise self.value Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application session.commit() Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:24:34.680501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:24:34.682067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:24:34.683169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:24:34.684304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f64f3e6939a648d49257c919c1c2f8ce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:34.686013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 00:24:34.687898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 00:24:34.698332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 00:24:34.698332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 00:24:34.698332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:24:34.698332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:24:34.698332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:24:34.698332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:34.698332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 478/965] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Aug 30 00:24:34 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:34.699287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ebe6-e7df-49fc-9b8d-fa78d0a45a52 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:34.795198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ebe6-e7df-49fc-9b8d-fa78d0a45a52 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:34.824979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34326b-45cc-46ad-bea1-18eff371d092 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.825264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34326b-45cc-46ad-bea1-18eff371d092 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.825447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34326b-45cc-46ad-bea1-18eff371d092 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.831938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:34.832571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.832847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.833114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.833694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 479/966] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:34.835194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f451ed-7e84-4977-bb61-6e4f176bb2f9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:34.835477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f451ed-7e84-4977-bb61-6e4f176bb2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:34.835751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f451ed-7e84-4977-bb61-6e4f176bb2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:34.841571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:34.844368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:34.849850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:34.858658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-20f451ed-7e84-4977-bb61-6e4f176bb2f9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:34.858955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:34.860047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:34.861407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 488/967] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:34.865565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-20f451ed-7e84-4977-bb61-6e4f176bb2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:34.866543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:34.876705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:34.944750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 480/968] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:34.945432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f451ed-7e84-4977-bb61-6e4f176bb2f9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:34.987672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe25f0c-d1be-4017-a4fb-3a8e1ca6d44d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:35.031698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:35.032433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:35.032836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:35.033180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:35.034026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:35.034395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:35.035894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:35.076336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 489/969] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Aug 30 00:24:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:35.080723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f451ed-7e84-4977-bb61-6e4f176bb2f9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:35.122943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:35.123644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:35.123923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:35.124192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:35.127949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:35.137876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:35.143505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:35.144526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:35.145352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 481/970] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 30 00:24:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:35.150846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:35.219285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:35.219953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:35.262023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c16f8-d205-4404-83bc-5d86535b80bd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:35.304632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:35.305707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:35.305991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:35.306258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:35.307468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:35.307468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:35.308631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:35.318213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 490/971] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 30 00:24:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:35.324644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:35.347447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c253d1-c3bc-4413-9cdc-15e2bab3252d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:35.396923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:35.397564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:35.397848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:35.398120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:35.398850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:35.400343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:35.425589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 482/972] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:35 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:35.444840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbb98d-b5ec-416c-869c-30f24e3e19cf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:35.474233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:35.492331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:35.493000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:35.493251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:35.493529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:35.507898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:35.509422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:35.525374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:35.526487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:35.528062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:35.528062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:35.528062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:35.528062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 491/973] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:35.532543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:35.602091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:35.652334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce44dae-3fc9-4086-b259-31b3ba30c950 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:35.694061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:35.694662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:35.694932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:35.695191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:35.695826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:35.696246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:35.697615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:35.709574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 483/974] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:35.715465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:35.819412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03c159-79f7-4653-8443-2bd4774bfc75 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:35.857249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:35.857916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:35.858195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:35.858445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:35.866801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:35.868264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:35.880264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:35.881332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:35.882320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 492/975] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:24:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:35.889288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:35.995399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ec08e-a316-4142-bd0f-2a2cef2ff398 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:36.012492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:36.031420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b442c9-acf8-4754-a3e1-8da21a57202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:36.032023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b442c9-acf8-4754-a3e1-8da21a57202f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.032293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b442c9-acf8-4754-a3e1-8da21a57202f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.032554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b442c9-acf8-4754-a3e1-8da21a57202f None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.033289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b442c9-acf8-4754-a3e1-8da21a57202f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:36.033597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b442c9-acf8-4754-a3e1-8da21a57202f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:36.035050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b442c9-acf8-4754-a3e1-8da21a57202f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:36.052697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 484/976] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Aug 30 00:24:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:36.058380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:36.093930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:36.164831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d584fd-363c-42a9-bd67-566b52fd131a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:36.199095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:36.199631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.199942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.200194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.274609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:36.276057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:36.310383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:36.382264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 493/977] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:36 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:36.384793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc3f51-9f2a-4b5f-b3ce-5c17fe1c1ed5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.385137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc3f51-9f2a-4b5f-b3ce-5c17fe1c1ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.385478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc3f51-9f2a-4b5f-b3ce-5c17fe1c1ed5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.387153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 485/978] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:36.387859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:36.396031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55824634-3d94-4f13-b050-eca28ac83572 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.396317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55824634-3d94-4f13-b050-eca28ac83572 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.396587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55824634-3d94-4f13-b050-eca28ac83572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.415699 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-55824634-3d94-4f13-b050-eca28ac83572 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:36.416930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-55824634-3d94-4f13-b050-eca28ac83572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:36.488256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 486/979] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:36.495304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeefeb7-40ce-448e-88d6-c1bf1358dece None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:36.530965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:36.531614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.531891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.532156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.534476 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:36.544217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:36.545833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:36.560851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:36.561827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:36.562715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:36.562715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:36.562715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:36.565882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 494/980] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:36.567625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55824634-3d94-4f13-b050-eca28ac83572 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:36.670062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55824634-3d94-4f13-b050-eca28ac83572 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:36.672286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:36.705528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:36.706144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.706411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.706678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.707312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:36.707606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:36.708950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:36.720246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 487/981] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:36.725693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:36.751421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:36.832869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfef25b-596f-422e-947a-eda672e7d193 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:36.858340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ead5-b49b-4367-a7d5-83f60dc5771a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:36.868711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:36.869665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.869945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.870355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.877376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:36.879144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:36.890595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:36.891520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:36.893142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 495/982] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:36.895304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:36.895938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:36.896197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:36.896740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:36.897329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:36.897424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:36.898727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:36.908428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:36.909451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:36.914441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 488/983] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:36.916450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:36.946637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:36.952112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:37.008109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2478988-0c46-4166-8f8f-41b43ecadfb1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:37.024263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653fb9f-f43d-4dca-ab28-dc77d41ad2a4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:37.042455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:37.043056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.043328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.043592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.044277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:37.044578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:37.046056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:37.059327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:37.059942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.060219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.060524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.061177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:37.061463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:37.062861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:37.064498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 496/984] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:37.065391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:37.072703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 489/985] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:37.073750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:37.167647 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:37.177489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae4db-a19a-4d91-9e94-7defab3d98cd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:37.177810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7a3b4-c2f4-4641-9731-cef838d0a6bb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:37.186209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:37.214851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:37.215713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.216145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.216550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.217325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:37.217437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aabc73-c34d-450b-9294-02e43fa0da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:37.217909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:37.218039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabc73-c34d-450b-9294-02e43fa0da98 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.218240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabc73-c34d-450b-9294-02e43fa0da98 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.218511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabc73-c34d-450b-9294-02e43fa0da98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.219238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aabc73-c34d-450b-9294-02e43fa0da98 None admin] RBAC: Adding query filter params (role.id=864b56d673994ec2a8c8d6fbbeadab9b, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=41b554a0c7e14ba381185ce80cac34af) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:37.219546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aabc73-c34d-450b-9294-02e43fa0da98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:37.220196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:37.220985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aabc73-c34d-450b-9294-02e43fa0da98 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:37.226837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 490/986] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:37.235744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 497/987] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:37 2022] GET /identity/v3/role_assignments?user.id=41b554a0c7e14ba381185ce80cac34af&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=864b56d673994ec2a8c8d6fbbeadab9b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:37.235949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:37.349270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db97ff-ee8b-4d2c-bcbe-bb0a6959ec2d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:37.376098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec4909-6ffe-4f18-adae-efd2a1d16d2a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.376384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec4909-6ffe-4f18-adae-efd2a1d16d2a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.376655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec4909-6ffe-4f18-adae-efd2a1d16d2a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.378397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 498/988] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:37.385353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fbbff-f141-4344-aeb8-08230647383c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.385690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fbbff-f141-4344-aeb8-08230647383c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.385952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fbbff-f141-4344-aeb8-08230647383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.395773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:37.396389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.396670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.396942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.397693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] RBAC: Adding query filter params (interface=admin, service_id=d17beeb96384404db8df02a680c18a8b, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:37.398011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:37.399374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:37.405428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 491/989] 10.222.0.42 () {56 vars in 1249 bytes} [Tue Aug 30 00:24:37 2022] GET /identity/v3/endpoints?service_id=d17beeb96384404db8df02a680c18a8b&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:37.409830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ff1fbbff-f141-4344-aeb8-08230647383c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:37.410306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:37.411040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ff1fbbff-f141-4344-aeb8-08230647383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:37.433831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:37.493252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 499/990] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:37.518566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80b485-ab11-468d-81ee-81f9de2a011c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:37.552700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:37.553298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.553599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.553876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.554488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:37.555858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:37.562585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 492/991] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:37 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:24:37.770340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fbbff-f141-4344-aeb8-08230647383c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:37.867526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:37.872136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fbbff-f141-4344-aeb8-08230647383c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:37.909291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:37.909971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:37.910246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:37.910618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:37.911217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:37.912605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:37.923327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:37.924381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:37.925243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:37.926569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 500/992] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:37.930776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:38.021272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:38.037205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79f995-2537-41ec-a0bb-0ceafe2549aa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:38.070119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:38.070728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:38.071085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:38.071399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:38.071989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:38.072286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:38.073683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:38.083423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 493/993] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:38.084393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:38.192899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de6840-2cd7-4037-ad32-8f0a1b3e4bd9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:38.226503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:38.226977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:38.227256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:38.227526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:38.228150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:38.228467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:38.229861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:38.235011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 501/994] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:38.241090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:38.349361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2021a-5eaf-4afe-9918-f25b4bb13e20 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:38.390955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccac1b-393c-4e5a-afc8-3571d1329f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:38.391580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccac1b-393c-4e5a-afc8-3571d1329f8d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:38.391854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccac1b-393c-4e5a-afc8-3571d1329f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:38.392121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccac1b-393c-4e5a-afc8-3571d1329f8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:38.392826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccac1b-393c-4e5a-afc8-3571d1329f8d None admin] RBAC: Adding query filter params (interface=public, service_id=3c7dbf147afe4a9ab7430736d7a69673, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:38.393169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccac1b-393c-4e5a-afc8-3571d1329f8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:38.394563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccac1b-393c-4e5a-afc8-3571d1329f8d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:38.404834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 494/995] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:24:38 2022] GET /identity/v3/endpoints?service_id=3c7dbf147afe4a9ab7430736d7a69673&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:38.406176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:38.438037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:38.513286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991c078-38b7-4c06-862b-2246b3bdf516 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:38.554630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b770d2-9d5b-4a34-a124-0d6ce87945e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:38.555251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b770d2-9d5b-4a34-a124-0d6ce87945e1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:38.555529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b770d2-9d5b-4a34-a124-0d6ce87945e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:38.555780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b770d2-9d5b-4a34-a124-0d6ce87945e1 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:38.556397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b770d2-9d5b-4a34-a124-0d6ce87945e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:38.557839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b770d2-9d5b-4a34-a124-0d6ce87945e1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:38.569121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 502/996] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:38 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:24:39.183847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa67e9-008e-43c9-8320-faf4d6b1eb85 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:39.184417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa67e9-008e-43c9-8320-faf4d6b1eb85 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:39.184417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa67e9-008e-43c9-8320-faf4d6b1eb85 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:39.185805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 495/997] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:39.191326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4fa3f-e592-409a-a8f6-4f1781e253c0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:39.191744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4fa3f-e592-409a-a8f6-4f1781e253c0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:39.191933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4fa3f-e592-409a-a8f6-4f1781e253c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:39.212109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c5d4fa3f-e592-409a-a8f6-4f1781e253c0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:39.213354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5d4fa3f-e592-409a-a8f6-4f1781e253c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:39.282636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 503/998] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:39.461012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984498c-7b76-495e-9da2-2f132c232d74 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:39.461378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984498c-7b76-495e-9da2-2f132c232d74 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:39.461603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984498c-7b76-495e-9da2-2f132c232d74 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:39.463102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 496/999] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:39.468169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24e5e-5884-4889-9506-32d5d5f4e8c4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:39.468456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24e5e-5884-4889-9506-32d5d5f4e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:39.468725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24e5e-5884-4889-9506-32d5d5f4e8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:39.487842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e4b24e5e-5884-4889-9506-32d5d5f4e8c4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:39.489015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e4b24e5e-5884-4889-9506-32d5d5f4e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:39.507958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:39.547670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984498c-7b76-495e-9da2-2f132c232d74 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:39.561862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 504/1000] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:39.564157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:39.660451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984498c-7b76-495e-9da2-2f132c232d74 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:39.695211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:39.695830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:39.696102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:39.696369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] PATH_INFO: `/v3/services/image` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:39.696946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:39.698398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:39.710113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:39.711259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:39.712095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 497/1001] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 30 00:24:39 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:39.717313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24e5e-5884-4889-9506-32d5d5f4e8c4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:39.820852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24e5e-5884-4889-9506-32d5d5f4e8c4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:39.831793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:39.857883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:39.858512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:39.858796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:39.859071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:39.859699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] RBAC: Adding query filter params (name=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:39.860007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:39.861382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:39.866603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 505/1002] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:39.871922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:39.895273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:39.923399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:39.951261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d7d91-a5a8-481d-95a9-e55150f21088 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:39.981951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3697ae-185d-4749-8c9d-aff2400334ee None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:39.987700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:39.988331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:39.988608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:39.988877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:39.989461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:39.990943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:39.999842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:40.000834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:40.001862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 498/1003] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Aug 30 00:24:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:40.007097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:40.022652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:40.023268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:40.023549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:40.023827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:40.024449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] RBAC: Adding query filter params (type=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:40.024755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:40.026226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:40.041595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 506/1004] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:40.129434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1941-8dac-45e0-81fa-1b81bee6ad93 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:40.167555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:40.168184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:40.168478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:40.168726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:40.169365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:40.169693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:40.171161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:40.177100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 499/1005] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:40.182684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:40.268927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:40.289934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426581b-2ec6-470b-8eaf-1b2316ecb458 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:40.324814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2b093-e231-4ca7-b208-e8b26bb17fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:40.325433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2b093-e231-4ca7-b208-e8b26bb17fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:40.325735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2b093-e231-4ca7-b208-e8b26bb17fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:40.326083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2b093-e231-4ca7-b208-e8b26bb17fb1 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:40.326686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2b093-e231-4ca7-b208-e8b26bb17fb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:40.326999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2b093-e231-4ca7-b208-e8b26bb17fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:40.328361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2b093-e231-4ca7-b208-e8b26bb17fb1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:40.337609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 507/1006] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Aug 30 00:24:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:40.339639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:40.343704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:40.450724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deaf9-3d9e-4c31-ae90-cfb7cbee5889 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:40.460086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795b87-d9f1-4af1-9e14-644d40dc0596 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:40.460390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795b87-d9f1-4af1-9e14-644d40dc0596 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:40.460656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795b87-d9f1-4af1-9e14-644d40dc0596 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:40.462202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 508/1007] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:40.466956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777e53-7d97-4644-a3ab-dbf997c5cf89 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:40.467232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777e53-7d97-4644-a3ab-dbf997c5cf89 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:40.467498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777e53-7d97-4644-a3ab-dbf997c5cf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:40.485688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-01777e53-7d97-4644-a3ab-dbf997c5cf89 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:40.486873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-01777e53-7d97-4644-a3ab-dbf997c5cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:40.488775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:40.489401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:40.489713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:40.489973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:40.490663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:40.492026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:40.510068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 500/1008] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:24:40.575688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 509/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:40.843792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:40.908976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:40.950228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf643ba-94fe-42d7-b46d-bf15f559f6d4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:40.984473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:40.985116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:40.985393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:40.985691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:40.986290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:40.987681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:40.996683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:40.998039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:24:40.998951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:41.001929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 501/1010] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:41.004047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01777e53-7d97-4644-a3ab-dbf997c5cf89 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:41.077935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:41.112180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01777e53-7d97-4644-a3ab-dbf997c5cf89 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:41.149267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:41.149935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:41.150216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:41.150484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:41.151128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:41.151428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:41.152821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:41.158191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 510/1011] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:41.163850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:41.263852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f110b-c16a-4aca-8e87-651a9e243f67 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:41.291199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:41.301276 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ae48-941b-440e-8bab-7007787ee2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:41.301921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ae48-941b-440e-8bab-7007787ee2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:41.302201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ae48-941b-440e-8bab-7007787ee2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:41.302468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ae48-941b-440e-8bab-7007787ee2e1 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:41.303098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ae48-941b-440e-8bab-7007787ee2e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:41.303401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ae48-941b-440e-8bab-7007787ee2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:41.304770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ae48-941b-440e-8bab-7007787ee2e1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:41.314431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 502/1012] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Aug 30 00:24:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:41.316024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:41.426925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cdbbd-153c-484e-bb0b-367346472e68 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:41.461210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a324-b318-463e-84c7-6d55168eda8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:41.461849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a324-b318-463e-84c7-6d55168eda8c None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:41.462130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a324-b318-463e-84c7-6d55168eda8c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:41.462397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a324-b318-463e-84c7-6d55168eda8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:41.463066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a324-b318-463e-84c7-6d55168eda8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:41.464436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a324-b318-463e-84c7-6d55168eda8c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:41.469169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:41.490260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 511/1013] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:24:41.937244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271acdd-7106-468e-9ebc-78ac2814c7b1 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:41.937826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271acdd-7106-468e-9ebc-78ac2814c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:41.937826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271acdd-7106-468e-9ebc-78ac2814c7b1 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:41.939300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 503/1014] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:41.944354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3df25-5b1b-4eef-beb0-694d6031b0dc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:41.944617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3df25-5b1b-4eef-beb0-694d6031b0dc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:41.944920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3df25-5b1b-4eef-beb0-694d6031b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:41.963669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-10a3df25-5b1b-4eef-beb0-694d6031b0dc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:41.964844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10a3df25-5b1b-4eef-beb0-694d6031b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:42.043240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 512/1015] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:41 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:42.303397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271acdd-7106-468e-9ebc-78ac2814c7b1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:42.414159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271acdd-7106-468e-9ebc-78ac2814c7b1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:42.424532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09bfba-26ad-4f35-867b-e7fe057f37d6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:42.425039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09bfba-26ad-4f35-867b-e7fe057f37d6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:42.425039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09bfba-26ad-4f35-867b-e7fe057f37d6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:42.426471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 513/1016] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:42.431382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a52b9-993a-4825-ab18-45520823f882 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:42.431633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a52b9-993a-4825-ab18-45520823f882 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:42.431900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a52b9-993a-4825-ab18-45520823f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:42.450198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3a1a52b9-993a-4825-ab18-45520823f882 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:42.451287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:42.451425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3a1a52b9-993a-4825-ab18-45520823f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:42.451931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:42.452207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:42.452472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:42.453125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:42.454530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:42.472454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 504/1017] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:42 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:42.535908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 514/1018] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:42.805440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:42.861209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:42.911885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4200721-0ad3-46d2-bc07-caf4ec89d010 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:42.947072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52720111-b0cb-4e6b-a0b2-2f67fa26d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:42.947751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720111-b0cb-4e6b-a0b2-2f67fa26d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:42.947965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720111-b0cb-4e6b-a0b2-2f67fa26d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:42.948236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52720111-b0cb-4e6b-a0b2-2f67fa26d4e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:42.949344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52720111-b0cb-4e6b-a0b2-2f67fa26d4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:42.950815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52720111-b0cb-4e6b-a0b2-2f67fa26d4e5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:42.952590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 505/1019] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:42.958356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a52b9-993a-4825-ab18-45520823f882 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:43.003434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:43.062550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a52b9-993a-4825-ab18-45520823f882 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:43.097138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f652b-3298-47c7-8776-111b5add65f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:43.097770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f652b-3298-47c7-8776-111b5add65f3 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:43.098052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f652b-3298-47c7-8776-111b5add65f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:43.098319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f652b-3298-47c7-8776-111b5add65f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:43.098972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f652b-3298-47c7-8776-111b5add65f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:43.100403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f652b-3298-47c7-8776-111b5add65f3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:43.133574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 515/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:24:42 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:43.501350 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612b05e-0559-449b-bbc5-e3ab25202272 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:43.501778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612b05e-0559-449b-bbc5-e3ab25202272 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:43.502068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612b05e-0559-449b-bbc5-e3ab25202272 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:43.503891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 506/1021] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:43.509337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c5b1-085f-44ba-b557-05927d6cce54 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:43.509827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c5b1-085f-44ba-b557-05927d6cce54 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:43.509903 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c5b1-085f-44ba-b557-05927d6cce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:43.528576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7390c5b1-085f-44ba-b557-05927d6cce54 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:43.529841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7390c5b1-085f-44ba-b557-05927d6cce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:43.601742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 516/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:43.871280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612b05e-0559-449b-bbc5-e3ab25202272 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:43.976278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612b05e-0559-449b-bbc5-e3ab25202272 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:43.998430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:44.015877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:44.016519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.016799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.017065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.028016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:44.032833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:44.034014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:44.038635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 507/1023] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 30 00:24:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:44.040496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c5b1-085f-44ba-b557-05927d6cce54 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:44.066113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:44.147286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c5b1-085f-44ba-b557-05927d6cce54 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:44.182808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:44.183426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.183700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.183970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.184634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:44.184933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:44.186384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:44.194684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 517/1024] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:44.200313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:44.305353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9f30-f070-4949-b8e0-f3ac133f4d5f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:44.340103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5387b-0684-4cde-9e83-baee44b4804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:44.340751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5387b-0684-4cde-9e83-baee44b4804a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.341026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5387b-0684-4cde-9e83-baee44b4804a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.341299 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5387b-0684-4cde-9e83-baee44b4804a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.351387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5387b-0684-4cde-9e83-baee44b4804a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:44.352812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5387b-0684-4cde-9e83-baee44b4804a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-95d5387b-0684-4cde-9e83-baee44b4804a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:44.367275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:44.368338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:44.369231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:44.369231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:44.369231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:44.373404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 508/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:44.374490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:44.380955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cde26-d2e7-4201-ad61-0b1a3b80b1b2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.381237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cde26-d2e7-4201-ad61-0b1a3b80b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.381506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cde26-d2e7-4201-ad61-0b1a3b80b1b2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.383154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 509/1026] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:44.391052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4339-28ef-473a-8d59-d0822d2c9cab None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.391760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4339-28ef-473a-8d59-d0822d2c9cab None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.391760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b4339-28ef-473a-8d59-d0822d2c9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.410573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0d2b4339-28ef-473a-8d59-d0822d2c9cab None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:44.411678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0d2b4339-28ef-473a-8d59-d0822d2c9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:44.437824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:44.474745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:44.481473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 510/1027] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:44.491659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72bc2b-9867-455d-a8a6-7ac36951bac8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:44.527946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:44.528578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.528815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.529108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.529802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:44.530106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:44.531487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:44.545919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 518/1028] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:44.549671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b4339-28ef-473a-8d59-d0822d2c9cab None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:44.654607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b4339-28ef-473a-8d59-d0822d2c9cab None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:44.691468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:44.692021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.692311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.692584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.701392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:44.703232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:44.715057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:44.716023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:44.716972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 511/1029] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:44.723977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:44.745194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:44.771082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:44.839304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e48c-6ca2-40c1-979a-4df95d3edf12 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:44.855038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d590-b5ba-4cde-b220-5e516e4b7d91 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:44.874412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:44.875043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.875323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.875594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.876330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:44.876641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:44.878547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:44.893077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:44.893742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:44.894525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:44.894805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] PATH_INFO: `/v3/services/image` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:44.895411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:44.896755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:44.897711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 519/1030] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:44.903402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:44.906153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:44.907166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:44.908030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:44.911899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:44.913647 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 512/1031] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:44.914602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.004912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.016086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a437-bd76-4f4e-99cf-ddae620cfa8c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.021851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7cd86-9b0b-442a-b788-7c07e1f20a27 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.051169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.051784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.052053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.052322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.058034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80b27-a1e9-4677-9fcc-75665362ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.058855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80b27-a1e9-4677-9fcc-75665362ec35 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.059285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80b27-a1e9-4677-9fcc-75665362ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.059701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80b27-a1e9-4677-9fcc-75665362ec35 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.060660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80b27-a1e9-4677-9fcc-75665362ec35 None admin] RBAC: Adding query filter params (name=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:45.060975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80b27-a1e9-4677-9fcc-75665362ec35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.062455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80b27-a1e9-4677-9fcc-75665362ec35 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.069951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 513/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:45.069951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794981-8bdb-450b-a60e-5cffff1a5e8d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.069951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794981-8bdb-450b-a60e-5cffff1a5e8d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.069951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c794981-8bdb-450b-a60e-5cffff1a5e8d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.070680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 514/1033] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:45.073129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c794981-8bdb-450b-a60e-5cffff1a5e8d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.123210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.124750 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.127368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.178387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c794981-8bdb-450b-a60e-5cffff1a5e8d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.215646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4d25f-a1f8-4901-854c-ab019d5c2ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.216243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d25f-a1f8-4901-854c-ab019d5c2ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.216538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d25f-a1f8-4901-854c-ab019d5c2ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.216818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d25f-a1f8-4901-854c-ab019d5c2ca3 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.217442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d25f-a1f8-4901-854c-ab019d5c2ca3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:45.217763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d25f-a1f8-4901-854c-ab019d5c2ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.219131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d25f-a1f8-4901-854c-ab019d5c2ca3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.224057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 515/1034] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:45.224468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 520/1035] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:45.226836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933cef6-ab8b-4771-82b0-0a93780e2882 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.227119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933cef6-ab8b-4771-82b0-0a93780e2882 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.227389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933cef6-ab8b-4771-82b0-0a93780e2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.230062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.244898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c933cef6-ab8b-4771-82b0-0a93780e2882 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:45.246124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c933cef6-ab8b-4771-82b0-0a93780e2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:45.255720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.313805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 516/1036] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:45.314646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933cef6-ab8b-4771-82b0-0a93780e2882 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.328822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7300b73-6e6f-42f2-b12f-c5dd5865e087 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.332636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.366515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.367121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.367401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.367667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.368365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] RBAC: Adding query filter params (interface=public, service_id=393dab9a97be4883b893e41d5e3e4cef, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:45.368668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.370066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.375046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 521/1037] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/endpoints?service_id=393dab9a97be4883b893e41d5e3e4cef&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:45.381462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.435866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933cef6-ab8b-4771-82b0-0a93780e2882 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.471320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.471956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.472231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.472495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.483583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.485038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.487909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.489316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581066-7eb8-4d54-9964-ab5d9fcad175 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:45.501138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:45.502170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:45.503441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:45.503441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:45.503441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:45.503441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 517/1038] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:45.508550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.527038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.527653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.527928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.528198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.528812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.530585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.537584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 522/1039] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:24:45.579843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.616886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.620741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e93292-5297-44ad-acc3-23483fc2fc5f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.661283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.662406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.662683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.662952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.663621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:45.663920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.665440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.678993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 518/1040] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:45.684647 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.699823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9b1c9-6307-4fb3-ad43-18e522dd10ec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.735898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.736575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.736854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.737121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.738271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.739711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.745622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 523/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:45.747391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.749604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.799960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939853-4872-4077-8bb9-56acef68fa24 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.835278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.835919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.836196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.836467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.843344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.844783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.854276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:45.856964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:45.858241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:45.859598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:45.860040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24640ec3-3aca-44b5-9e5a-d5170cf8bef6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.860113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 519/1042] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:45.863827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:45.895681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:45.896295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:45.896573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:45.896842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:45.897492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:45.898954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:45.923456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 524/1043] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:24:45 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:24:45.975808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5547d5e-9cad-4eec-8334-0952b26f086e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:45.995749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:46.019772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a71eb-47c8-41be-993e-c826698a953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:46.020557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a71eb-47c8-41be-993e-c826698a953e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:46.020877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a71eb-47c8-41be-993e-c826698a953e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:46.021210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a71eb-47c8-41be-993e-c826698a953e None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:46.022021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a71eb-47c8-41be-993e-c826698a953e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:46.022436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a71eb-47c8-41be-993e-c826698a953e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:46.023932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a71eb-47c8-41be-993e-c826698a953e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:46.039370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 520/1044] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:46.045435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:46.154558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b089fc-7acd-44b7-a17f-3547dbdca243 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:46.188963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9acec5-be16-4637-96f5-7cbb79f11ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:46.189825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9acec5-be16-4637-96f5-7cbb79f11ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:46.190195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9acec5-be16-4637-96f5-7cbb79f11ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:46.190554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9acec5-be16-4637-96f5-7cbb79f11ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:46.191368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9acec5-be16-4637-96f5-7cbb79f11ee6 None admin] RBAC: Adding query filter params (role.id=864b56d673994ec2a8c8d6fbbeadab9b, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=aa4e1f12814a4923a2a37d771c59d40c) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:46.191764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9acec5-be16-4637-96f5-7cbb79f11ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:46.193267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9acec5-be16-4637-96f5-7cbb79f11ee6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:46.199220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 525/1045] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:46 2022] GET /identity/v3/role_assignments?user.id=aa4e1f12814a4923a2a37d771c59d40c&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=864b56d673994ec2a8c8d6fbbeadab9b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:47.480351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340fc1-51d8-4049-88db-078b2c5981d8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:47.480912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340fc1-51d8-4049-88db-078b2c5981d8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:47.480912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340fc1-51d8-4049-88db-078b2c5981d8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:47.482271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 521/1046] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:47.487858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f02a3-a7de-43d0-a4cc-f3c8737104e2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:47.488340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f02a3-a7de-43d0-a4cc-f3c8737104e2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:47.488430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f02a3-a7de-43d0-a4cc-f3c8737104e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:47.507714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2d3f02a3-a7de-43d0-a4cc-f3c8737104e2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:47.508907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2d3f02a3-a7de-43d0-a4cc-f3c8737104e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:47.524962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:47.584051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 526/1047] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:47.849848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd340fc1-51d8-4049-88db-078b2c5981d8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:47.873916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124438b-2e17-4a5d-9c52-3fdb5fb209bd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:47.874234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124438b-2e17-4a5d-9c52-3fdb5fb209bd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:47.874473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124438b-2e17-4a5d-9c52-3fdb5fb209bd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:47.875871 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 527/1048] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:47.881038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21035-6e54-463b-a8d0-ef7447118b93 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:47.881318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21035-6e54-463b-a8d0-ef7447118b93 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:47.881628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21035-6e54-463b-a8d0-ef7447118b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:47.900265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bfa21035-6e54-463b-a8d0-ef7447118b93 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:47.901453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bfa21035-6e54-463b-a8d0-ef7447118b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:47.964099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd340fc1-51d8-4049-88db-078b2c5981d8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:47.976202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 528/1049] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:48.004806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b202f-a558-437d-9cb8-84c4fac1b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.005576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b202f-a558-437d-9cb8-84c4fac1b83f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.005911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b202f-a558-437d-9cb8-84c4fac1b83f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.006239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b202f-a558-437d-9cb8-84c4fac1b83f None admin] PATH_INFO: `/v3/services/image` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.006883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b202f-a558-437d-9cb8-84c4fac1b83f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:48.008305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b202f-a558-437d-9cb8-84c4fac1b83f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e60b202f-a558-437d-9cb8-84c4fac1b83f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:48.017347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:48.018587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:24:48.019640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:48.020658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 522/1050] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Aug 30 00:24:47 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:48.025768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21035-6e54-463b-a8d0-ef7447118b93 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.057619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a93a2-c0d1-4697-9af0-f5b45612ba9b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.057901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a93a2-c0d1-4697-9af0-f5b45612ba9b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.058414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a93a2-c0d1-4697-9af0-f5b45612ba9b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.060399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 523/1051] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:24:48.065179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38c278-c762-4e2d-bbf6-a6a0f9b1236e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.065431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38c278-c762-4e2d-bbf6-a6a0f9b1236e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.065734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38c278-c762-4e2d-bbf6-a6a0f9b1236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.085153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9b38c278-c762-4e2d-bbf6-a6a0f9b1236e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:48.086374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9b38c278-c762-4e2d-bbf6-a6a0f9b1236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:48.121454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.123965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.144610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21035-6e54-463b-a8d0-ef7447118b93 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.161411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 524/1052] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:48.181090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.181801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.182141 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.182473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.183164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] RBAC: Adding query filter params (name=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:48.183528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:48.184955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:48.195141 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 529/1053] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:48.196090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38c278-c762-4e2d-bbf6-a6a0f9b1236e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.238683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.306654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38c278-c762-4e2d-bbf6-a6a0f9b1236e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.339660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27d152-1328-4d33-adbc-85cea711739b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.345401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.346037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.346312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.346585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.347196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] RBAC: Adding query filter params (type=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:48.347489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:48.348883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:48.354463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 525/1054] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:48.359927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.379046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.379653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.379998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.380337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.392922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:48.397777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:48.398697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:48.399748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 530/1055] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:48.404899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.406224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.409246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.475414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46001e52-ecf0-4d26-8868-d36220fdc69a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.505589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fb55d-ebec-4870-b126-5dffe5ca3685 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.510636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.511236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.511510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.511777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.512438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:48.513875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:48.534109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 526/1056] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:24:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:24:48.535047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.565331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.566591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.566889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.567123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.568147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:48.568452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:48.570891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:48.581819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 531/1057] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:48.588126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.646130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.657292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.662817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d285f-a74c-44b3-8c42-a62a944ad22f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.700723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.701416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.702451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.702451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.703982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ba6d-0d82-4580-98b9-81a06fba5dd6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.717453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:48.722805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:48.723964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:48.724945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 527/1058] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:48.732855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.747006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.747649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.747997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.748269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] PATH_INFO: `/v3/users/5177923664464938aa5f3bb355605ae7` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.763568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] RBAC: Authorizing `identity:get_user(user_id=5177923664464938aa5f3bb355605ae7)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:48.765217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:48.771784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 532/1059] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/users/5177923664464938aa5f3bb355605ae7 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:48.772700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.845503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23dca6-027c-4dd3-92d5-39b04c9290f8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.878211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1afe4-3baf-4655-a2a4-ab7ef93f8e25 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:48.881113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.881767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.882045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.882305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.882972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:48.883269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:48.884636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:48.893578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 528/1060] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:48.898954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:48.901577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.916306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:48.924332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:48.925015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:48.925363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:48.925736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:48.998852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.000441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.011889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5e9f8-c97e-4474-8974-a051da64ac50 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.049177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.050082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.050363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.050631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.062441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.064042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:49.079579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:49.080757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:49.081857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:49.081857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:49.081857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:49.083002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 529/1061] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:49.088636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.108427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 533/1062] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:24:49.114024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.136635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:49.156012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:49.194968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543854f-8149-4495-9fe6-d7f463fba03c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.226849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad0ede-23c1-43a4-a50a-721b07329b97 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.231985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.232915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.233395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.233942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.234889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:49.235371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.237042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.250696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 530/1063] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:49.257496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.266741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.267577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.268006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.268315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.269447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] RBAC: Authorizing `identity:get_project(project_id=87c4617115eb4f509c486b9e700ef821)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.270952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.272919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 534/1064] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/projects/87c4617115eb4f509c486b9e700ef821 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:49.279295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.366285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aee889-e315-405e-b306-abf2ba251a89 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.371453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:49.392855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2cf5-fd9f-404d-a663-5ed5110dcfc2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.399437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:49.411691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.412254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.412531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.412799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.420943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.422529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.427736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.428339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.428613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.428881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.429624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=87c4617115eb4f509c486b9e700ef821, user.id=5177923664464938aa5f3bb355605ae7) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:49.429930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.431363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:49.435280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:49.436392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:49.437502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 531/1065] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:49.439787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 535/1066] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/role_assignments?user.id=5177923664464938aa5f3bb355605ae7&scope.project.id=87c4617115eb4f509c486b9e700ef821&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:49.452624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.565947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa4415-b046-4c97-a1b7-c1a6ea116a2f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.603335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.603938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.604211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.604479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.605270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:49.605587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.606986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.625487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 532/1067] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:49.631523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.733401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9be530-94c1-494f-a4e0-0c5e15ee4052 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.767799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.768431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.768710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.768981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.779755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.781213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:49.795495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:49.796483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:49.797407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:49.797407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:49.797407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:49.802933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 536/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:49.803073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.856536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:49.919877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1545be-710e-41ab-a1c2-bb29ce2e913b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:49.959339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:49.960199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:49.960624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:49.961062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:49.961894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:49.962359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:49.963877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:49.976726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 533/1069] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:49.982602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:49.986754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:50.089865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7534aae-732b-4096-9a02-136098bb6d3f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:50.124989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:50.125648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:50.125931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:50.126198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:50.133321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:50.134799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:50.146095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:50.146971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:50.147867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:50.149022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 537/1070] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:50.153018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:50.264600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a579a-756d-4966-a60b-79e8d843dbfb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:50.266073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:50.300956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328763-73ba-4c37-a913-2ff61c8ea979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:50.301577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328763-73ba-4c37-a913-2ff61c8ea979 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:50.301862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328763-73ba-4c37-a913-2ff61c8ea979 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:50.302133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328763-73ba-4c37-a913-2ff61c8ea979 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:50.302817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328763-73ba-4c37-a913-2ff61c8ea979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:50.303128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328763-73ba-4c37-a913-2ff61c8ea979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:50.304530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328763-73ba-4c37-a913-2ff61c8ea979 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:50.321817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 534/1071] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:50.323060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:50.397448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:50.437252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e9f6c-3694-49b2-b51e-58488e86d43b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:50.472892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:50.473577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:50.473861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:50.474131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/aa4e1f12814a4923a2a37d771c59d40c/roles/864b56d673994ec2a8c8d6fbbeadab9b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:50.476342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=aa4e1f12814a4923a2a37d771c59d40c, role_id=864b56d673994ec2a8c8d6fbbeadab9b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:50.477259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635667-c0ce-43d0-83de-52ecade9545e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:50.477578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635667-c0ce-43d0-83de-52ecade9545e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:50.477800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:50.477915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52635667-c0ce-43d0-83de-52ecade9545e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:50.479302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 535/1072] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:50.484795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7abe-0df0-4859-af3d-6948572caceb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:50.485180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7abe-0df0-4859-af3d-6948572caceb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:50.485584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7abe-0df0-4859-af3d-6948572caceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:50.492982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 538/1073] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:24:50 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/aa4e1f12814a4923a2a37d771c59d40c/roles/864b56d673994ec2a8c8d6fbbeadab9b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:24:50.505501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a8cf7abe-0df0-4859-af3d-6948572caceb None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:50.506803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8cf7abe-0df0-4859-af3d-6948572caceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:50.583803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 536/1074] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:50.844846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:50.946126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a4bee-9632-4145-a5b2-5b894bb19b47 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:50.969935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:50.983645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:50.984254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:50.984533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:50.984794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:51.056061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:51.057503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:51.155744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 539/1075] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:51.161367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7abe-0df0-4859-af3d-6948572caceb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:51.254068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:51.263761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7abe-0df0-4859-af3d-6948572caceb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:51.298726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59162b4-d459-43f4-8774-435744bba4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:51.299356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59162b4-d459-43f4-8774-435744bba4dd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:51.299622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59162b4-d459-43f4-8774-435744bba4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:51.299883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59162b4-d459-43f4-8774-435744bba4dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:51.310145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59162b4-d459-43f4-8774-435744bba4dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:51.311626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59162b4-d459-43f4-8774-435744bba4dd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d59162b4-d459-43f4-8774-435744bba4dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:51.326506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:51.327696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:51.328873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:51.328873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:51.328873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:51.333570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 537/1076] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:51.334004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:51.357435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5161b4-e5a2-43bd-9587-bfc7b2a08706 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:51.357756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5161b4-e5a2-43bd-9587-bfc7b2a08706 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:51.358028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5161b4-e5a2-43bd-9587-bfc7b2a08706 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:51.359409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 538/1077] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:51.360597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:51.365434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29af599-8cc4-48b6-9c9b-a6843770781f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:51.365971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29af599-8cc4-48b6-9c9b-a6843770781f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:51.366430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29af599-8cc4-48b6-9c9b-a6843770781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:51.386505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d29af599-8cc4-48b6-9c9b-a6843770781f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:51.387833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d29af599-8cc4-48b6-9c9b-a6843770781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:51.448417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a766e-c13f-4638-94ca-ebefc24f1009 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:51.473874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 539/1078] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:51.488726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:51.489433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:51.489788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:51.490110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:51.490942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:51.491323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:51.493432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:51.509237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 540/1079] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:51.732701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29af599-8cc4-48b6-9c9b-a6843770781f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:51.811627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:51.839196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29af599-8cc4-48b6-9c9b-a6843770781f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:51.883048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:51.883684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:51.883960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:51.884230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:51.896480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:51.902198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:51.903182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:51.904086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 540/1080] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:51.910184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:52.001803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:52.019915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc7e45-c808-4071-bb96-0fec6c70e5f9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:52.055312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:52.055905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:52.056177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:52.056439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:52.057091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:52.057384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:52.058784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:52.067621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 541/1081] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:52.073790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:52.181245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e0815-409e-4f84-99dc-11beb7d0c31e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:52.216080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:52.216719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:52.216994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:52.217250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] PATH_INFO: `/v3/users/5177923664464938aa5f3bb355605ae7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:52.218417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] RBAC: Authorizing `identity:get_user(user_id=5177923664464938aa5f3bb355605ae7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:52.219828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:52.221487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 541/1082] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:24:52 2022] GET /identity/v3/users/5177923664464938aa5f3bb355605ae7 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:52.227472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:52.331191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cfcd5-6a5e-43c9-9b1f-75949bf1fd13 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:52.365532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c8831-f4de-4819-b70b-03a1ab277f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:52.366181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8831-f4de-4819-b70b-03a1ab277f36 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:52.366462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8831-f4de-4819-b70b-03a1ab277f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:52.366735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8831-f4de-4819-b70b-03a1ab277f36 None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:52.367864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c8831-f4de-4819-b70b-03a1ab277f36 None admin] RBAC: Authorizing `identity:get_project(project_id=87c4617115eb4f509c486b9e700ef821)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:52.369303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c8831-f4de-4819-b70b-03a1ab277f36 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:52.371000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 542/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:24:52 2022] GET /identity/v3/projects/87c4617115eb4f509c486b9e700ef821 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:52.377026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:52.380255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:52.402444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b54a9-b6df-4263-86a8-4bea88806178 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:52.402723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b54a9-b6df-4263-86a8-4bea88806178 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:52.402992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b54a9-b6df-4263-86a8-4bea88806178 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:52.404513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 543/1084] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:52.409292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aa3c8-4a0e-4d6e-ad27-4dfdc9713cc6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:52.409602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aa3c8-4a0e-4d6e-ad27-4dfdc9713cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:52.409875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47aa3c8-4a0e-4d6e-ad27-4dfdc9713cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:52.428269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b47aa3c8-4a0e-4d6e-ad27-4dfdc9713cc6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:52.429471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b47aa3c8-4a0e-4d6e-ad27-4dfdc9713cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:52.439105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:52.483688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18305-1355-4595-bff8-15dbb9c38d83 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:52.499003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 544/1085] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:52.517002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:52.517688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:52.517961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:52.518228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821/users/5177923664464938aa5f3bb355605ae7/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:52.520188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] RBAC: Authorizing `identity:create_grant(project_id=87c4617115eb4f509c486b9e700ef821, user_id=5177923664464938aa5f3bb355605ae7, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:52.521639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:52.535024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 542/1086] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:24:52 2022] PUT /identity/v3/projects/87c4617115eb4f509c486b9e700ef821/users/5177923664464938aa5f3bb355605ae7/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:24:52.768492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aa3c8-4a0e-4d6e-ad27-4dfdc9713cc6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:52.878988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47aa3c8-4a0e-4d6e-ad27-4dfdc9713cc6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:52.916966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:52.917733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:52.918064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:52.918339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:52.930014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:52.935406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:52.936336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:52.937433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 545/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Aug 30 00:24:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:52.942982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:53.006840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:53.048579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533a394-fa62-4ef8-acee-f3d13d590e74 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:53.083102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:53.083700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:53.083988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:53.084214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:53.084895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:53.085198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:53.086571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:53.095231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 543/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 30 00:24:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:53.104433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:53.114764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:53.215119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13aa2cc-a10f-4fb4-b4cf-f085c4535c40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:53.249680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:53.250286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:53.250562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:53.250828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:53.262425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:53.263907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:53.278500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:53.279551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:53.280441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:53.280441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:53.280441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:53.280441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 546/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:53.286099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:53.391642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc31bc-9913-4280-bf22-288a9f2cba99 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:53.415166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:53.426946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:53.427547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:53.427822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:53.428088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:53.428747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:53.429049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:53.430487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:53.442307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 544/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:53.448136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:53.504033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:53.549828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5077e-f816-4029-bc89-998ab01e33ef None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:53.586057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:53.586686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:53.586956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:53.587219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:53.595283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:53.596715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:24:53.607894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:53.608842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:53.609861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 547/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Aug 30 00:24:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:53.615026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:53.715331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff1c30-d56e-4e28-b28e-b688884bb77f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:53.749755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:53.750348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:53.750621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:53.750886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:53.751608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:53.751907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:53.753688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:53.770751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 545/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Aug 30 00:24:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:53.776830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:53.885927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854184b-4ca7-47a1-bb89-75e38821ca75 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:53.902125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:53.921695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:53.922379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:53.922655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:53.922918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:53.993871 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:53.995217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:54.099847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 548/1093] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:54.105899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:54.152191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:54.211245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf574c-5c99-4e0f-86cb-e799fb06ba52 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:54.246211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49371395-3892-424a-aba8-a19480bd6d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:54.246752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49371395-3892-424a-aba8-a19480bd6d9f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.247022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49371395-3892-424a-aba8-a19480bd6d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.247282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49371395-3892-424a-aba8-a19480bd6d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.257652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49371395-3892-424a-aba8-a19480bd6d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:54.259082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49371395-3892-424a-aba8-a19480bd6d9f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-49371395-3892-424a-aba8-a19480bd6d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:24:54.274620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:54.275576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:24:54.276471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:24:54.276471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:24:54.276471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:24:54.276471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 546/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:54.282534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:54.302384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:54.388025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c2e2-30fe-467d-a5dc-aa407643c372 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:54.391163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002466d9-7989-450d-a83d-904d5b2c4fe4 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.391534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002466d9-7989-450d-a83d-904d5b2c4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.391902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002466d9-7989-450d-a83d-904d5b2c4fe4 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.393828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 547/1095] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:54.398626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005048a-e624-472d-a8ee-78df75efb2bf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.399010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005048a-e624-472d-a8ee-78df75efb2bf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.399274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005048a-e624-472d-a8ee-78df75efb2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.417032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9005048a-e624-472d-a8ee-78df75efb2bf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:54.418229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9005048a-e624-472d-a8ee-78df75efb2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:54.428207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:54.428816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.429097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.429369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.430042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:54.430344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:54.431714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:54.443007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 549/1096] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:54.448665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:54.486927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 548/1097] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:24:54.528488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:54.554136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8786-cbf1-4863-b59d-ce7750eccce0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:54.591791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:54.593567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.593860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.594125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.602251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:54.603702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:24:54.615127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:54.616037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:54.616932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 550/1098] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:24:54.622317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005048a-e624-472d-a8ee-78df75efb2bf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:54.648333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:54.723187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005048a-e624-472d-a8ee-78df75efb2bf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:54.751215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:54.758484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:54.759108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.759369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.759633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.760341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:54.760624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:54.762098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:54.773726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 549/1099] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:54.779764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:54.851878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030672-4da3-47a9-89d3-e75b846eb6c8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:54.863453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:54.880809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aface6df-1615-4ebb-bba0-5e2a837a3174 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:54.887998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:54.888652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.888926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.889194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.892168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:54.903096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:24:54.908081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:24:54.909010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:24:54.909910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 551/1100] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:24:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:24:54.915450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:54.917591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:54.918381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:54.918669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:54.918938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:54.920507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] RBAC: Adding query filter params (role.id=864b56d673994ec2a8c8d6fbbeadab9b, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=aa4e1f12814a4923a2a37d771c59d40c) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:54.920817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:54.922263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:54.928177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 550/1101] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:54 2022] GET /identity/v3/role_assignments?user.id=aa4e1f12814a4923a2a37d771c59d40c&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=864b56d673994ec2a8c8d6fbbeadab9b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:55.025242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf091dcd-bd2d-41b0-9b45-65cec99afa2a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:55.062933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:55.063445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:55.063723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:55.063995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:55.064665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:55.064965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:55.066582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:55.077726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 552/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:24:55.084060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:55.197621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2bdc-a6e8-4890-812e-a96ff7c94b16 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:55.237313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:55.238465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:55.238465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:55.238643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] PATH_INFO: `/v3/users/5177923664464938aa5f3bb355605ae7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:55.239740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=5177923664464938aa5f3bb355605ae7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:55.241169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:55.242807 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 551/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:24:55 2022] GET /identity/v3/users/5177923664464938aa5f3bb355605ae7 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:55.248937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:55.314956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:55.359857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9acd-8cec-459a-a73a-4a5113627ce3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:55.396083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:55.396740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:55.397023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:55.397316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:55.465506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:55.467027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:55.528580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:55.573243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 553/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:24:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:24:55.579264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:55.598486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:55.684565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af308f-3cab-4894-aa75-0678af955cb4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:55.719397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a913f7-7184-4eb4-97ac-a603c7343827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:55.720018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a913f7-7184-4eb4-97ac-a603c7343827 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:55.720297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a913f7-7184-4eb4-97ac-a603c7343827 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:55.720568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a913f7-7184-4eb4-97ac-a603c7343827 None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:55.721758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a913f7-7184-4eb4-97ac-a603c7343827 None admin] RBAC: Authorizing `identity:get_project(project_id=87c4617115eb4f509c486b9e700ef821)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:55.723213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a913f7-7184-4eb4-97ac-a603c7343827 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:55.724851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 552/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:24:55 2022] GET /identity/v3/projects/87c4617115eb4f509c486b9e700ef821 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:55.731112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:55.830152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30f00e-46d2-4c36-b273-0e410f98a38c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:55.864607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7be387-bc0e-4fe6-9be4-9ad17d54430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:55.865201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be387-bc0e-4fe6-9be4-9ad17d54430c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:55.865481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be387-bc0e-4fe6-9be4-9ad17d54430c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:55.865789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7be387-bc0e-4fe6-9be4-9ad17d54430c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:55.866494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7be387-bc0e-4fe6-9be4-9ad17d54430c None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=87c4617115eb4f509c486b9e700ef821, user.id=5177923664464938aa5f3bb355605ae7) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:24:55.866797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7be387-bc0e-4fe6-9be4-9ad17d54430c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:55.868213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7be387-bc0e-4fe6-9be4-9ad17d54430c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:55.874134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 554/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:24:55 2022] GET /identity/v3/role_assignments?user.id=5177923664464938aa5f3bb355605ae7&scope.project.id=87c4617115eb4f509c486b9e700ef821&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:57.770621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7496c-a9fe-4846-996b-7862b74489fa None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:57.771474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7496c-a9fe-4846-996b-7862b74489fa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:57.771474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7496c-a9fe-4846-996b-7862b74489fa None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:57.773606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 553/1107] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:24:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:24:57.782188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0271aa-e267-41c8-b6f6-e22660a0ab4b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:57.782870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0271aa-e267-41c8-b6f6-e22660a0ab4b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:57.783105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0271aa-e267-41c8-b6f6-e22660a0ab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:57.812846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0f0271aa-e267-41c8-b6f6-e22660a0ab4b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:57.814102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f0271aa-e267-41c8-b6f6-e22660a0ab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:57.832087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:57.887043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 555/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:24:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:24:58.162140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7496c-a9fe-4846-996b-7862b74489fa None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:58.254653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:58.271688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7496c-a9fe-4846-996b-7862b74489fa None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:58.319561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c9ff5-6ed3-4b03-a952-cd576d0e55cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:58.320179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c9ff5-6ed3-4b03-a952-cd576d0e55cd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:58.320449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c9ff5-6ed3-4b03-a952-cd576d0e55cd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:58.320711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c9ff5-6ed3-4b03-a952-cd576d0e55cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:58.321958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c9ff5-6ed3-4b03-a952-cd576d0e55cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:58.323416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c9ff5-6ed3-4b03-a952-cd576d0e55cd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:58.325001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 554/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:24:58.332389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0271aa-e267-41c8-b6f6-e22660a0ab4b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:58.446867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0271aa-e267-41c8-b6f6-e22660a0ab4b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:58.482699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efc0ae-1cc0-42ab-9bb2-c0954495d08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:58.483295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efc0ae-1cc0-42ab-9bb2-c0954495d08b None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:58.483571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efc0ae-1cc0-42ab-9bb2-c0954495d08b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:58.483841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efc0ae-1cc0-42ab-9bb2-c0954495d08b None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:58.484484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efc0ae-1cc0-42ab-9bb2-c0954495d08b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:58.485941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efc0ae-1cc0-42ab-9bb2-c0954495d08b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:58.510762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 556/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:24:58 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:25:00.438956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bedd7-758a-405f-9a9b-5fcc8811a22a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:00.439740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bedd7-758a-405f-9a9b-5fcc8811a22a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:00.439876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bedd7-758a-405f-9a9b-5fcc8811a22a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:00.442040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 555/1111] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:00.448444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825941-ec19-49b6-90fb-e87affdaf6e5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:00.449147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825941-ec19-49b6-90fb-e87affdaf6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:00.449292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825941-ec19-49b6-90fb-e87affdaf6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:00.470160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-93825941-ec19-49b6-90fb-e87affdaf6e5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:00.471348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-93825941-ec19-49b6-90fb-e87affdaf6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:00.473488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:00.546773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 557/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:00.820667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bedd7-758a-405f-9a9b-5fcc8811a22a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:00.932601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bedd7-758a-405f-9a9b-5fcc8811a22a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:00.967540 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:00.968145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:00.968419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:00.968685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] PATH_INFO: `/v3/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:00.970225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] RBAC: Authorizing `identity:get_role(role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:00.971588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:00.972906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 556/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:00 2022] GET /identity/v3/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:00.982206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825941-ec19-49b6-90fb-e87affdaf6e5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:01.102260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825941-ec19-49b6-90fb-e87affdaf6e5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:01.144200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:01.144831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:01.145091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:01.145381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] PATH_INFO: `/v3/users/697fd3d630ab4f4bb1318652008a50bd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:01.153095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:01.159844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] RBAC: Authorizing `identity:get_user(user_id=697fd3d630ab4f4bb1318652008a50bd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:01.161301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:01.162965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 558/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:00 2022] GET /identity/v3/users/697fd3d630ab4f4bb1318652008a50bd => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:01.170008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:01.193104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:01.273062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c483b-ecdd-4066-914b-7820d65c3e75 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:01.310001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:01.310634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:01.310911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:01.311178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:01.380950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:01.382353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:01.406460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:01.502895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 557/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:25:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:25:01.512025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:01.617211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c96-b626-44fe-aa65-67dde4337196 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:01.652817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e19e14-82b6-43fd-a40e-bb0078c78e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:01.653366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19e14-82b6-43fd-a40e-bb0078c78e13 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:01.653675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19e14-82b6-43fd-a40e-bb0078c78e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:01.653997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19e14-82b6-43fd-a40e-bb0078c78e13 None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:01.655247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e19e14-82b6-43fd-a40e-bb0078c78e13 None admin] RBAC: Authorizing `identity:get_project(project_id=87c4617115eb4f509c486b9e700ef821)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:01.656689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e19e14-82b6-43fd-a40e-bb0078c78e13 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:01.658370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 559/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:01 2022] GET /identity/v3/projects/87c4617115eb4f509c486b9e700ef821 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:01.665274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:01.784858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794667e9-8af3-4c7f-b5e0-94766fe89e88 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:01.809044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:01.826185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3797b4-e060-4177-9110-aa1cbf63c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:01.826786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3797b4-e060-4177-9110-aa1cbf63c18b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:01.827064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3797b4-e060-4177-9110-aa1cbf63c18b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:01.827337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3797b4-e060-4177-9110-aa1cbf63c18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:01.828072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3797b4-e060-4177-9110-aa1cbf63c18b None admin] RBAC: Adding query filter params (role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=87c4617115eb4f509c486b9e700ef821, user.id=697fd3d630ab4f4bb1318652008a50bd) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:01.828379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3797b4-e060-4177-9110-aa1cbf63c18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:01.829850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3797b4-e060-4177-9110-aa1cbf63c18b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:01.835880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 558/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:25:01 2022] GET /identity/v3/role_assignments?user.id=697fd3d630ab4f4bb1318652008a50bd&scope.project.id=87c4617115eb4f509c486b9e700ef821&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:03.730590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee316-d2d9-4e90-bc6c-69182c9d1e52 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:03.731477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee316-d2d9-4e90-bc6c-69182c9d1e52 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:03.731477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ee316-d2d9-4e90-bc6c-69182c9d1e52 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:03.733112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 560/1118] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:03.739353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f224-9562-447e-8620-d13ba7cb85dd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:03.739787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f224-9562-447e-8620-d13ba7cb85dd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:03.739978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f224-9562-447e-8620-d13ba7cb85dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:03.762311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-faf7f224-9562-447e-8620-d13ba7cb85dd None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:03.763496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-faf7f224-9562-447e-8620-d13ba7cb85dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:03.833911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 559/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:04.098361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee316-d2d9-4e90-bc6c-69182c9d1e52 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:04.170402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:04.214627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ee316-d2d9-4e90-bc6c-69182c9d1e52 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:04.251695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:04.252634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:04.252907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:04.253173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] PATH_INFO: `/v3/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:04.254654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] RBAC: Authorizing `identity:get_role(role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:04.256025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:04.257374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 561/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:04 2022] GET /identity/v3/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:04.264030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7f224-9562-447e-8620-d13ba7cb85dd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:04.375149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7f224-9562-447e-8620-d13ba7cb85dd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:04.390665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:04.411643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:04.412270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:04.412545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:04.412813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] PATH_INFO: `/v3/users/697fd3d630ab4f4bb1318652008a50bd` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:04.414003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=697fd3d630ab4f4bb1318652008a50bd)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:04.415440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:04.417022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 560/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:04 2022] GET /identity/v3/users/697fd3d630ab4f4bb1318652008a50bd => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:04.423337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:04.528334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6971371-dabd-4140-a152-0ec822494f18 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:04.560671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:04.567475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf68ae-a2a1-4c0e-81d6-39e3d983dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:04.568107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf68ae-a2a1-4c0e-81d6-39e3d983dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:04.568383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf68ae-a2a1-4c0e-81d6-39e3d983dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:04.568656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf68ae-a2a1-4c0e-81d6-39e3d983dfc6 None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:04.569844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf68ae-a2a1-4c0e-81d6-39e3d983dfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=87c4617115eb4f509c486b9e700ef821)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:04.571276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf68ae-a2a1-4c0e-81d6-39e3d983dfc6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:04.572903 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 562/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:04 2022] GET /identity/v3/projects/87c4617115eb4f509c486b9e700ef821 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:04.579768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:04.684824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bdf28-945c-4375-8925-d61a8be7d1d1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:04.722213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b498f-5910-4c42-8e2d-84941cd8d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:04.722857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b498f-5910-4c42-8e2d-84941cd8d046 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:04.723136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b498f-5910-4c42-8e2d-84941cd8d046 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:04.723405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b498f-5910-4c42-8e2d-84941cd8d046 None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821/users/697fd3d630ab4f4bb1318652008a50bd/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:04.725940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b498f-5910-4c42-8e2d-84941cd8d046 None admin] RBAC: Authorizing `identity:create_grant(project_id=87c4617115eb4f509c486b9e700ef821, user_id=697fd3d630ab4f4bb1318652008a50bd, role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:04.727402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b498f-5910-4c42-8e2d-84941cd8d046 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:04.743211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 561/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:25:04 2022] PUT /identity/v3/projects/87c4617115eb4f509c486b9e700ef821/users/697fd3d630ab4f4bb1318652008a50bd/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:25:06.591965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e9869-b839-440e-b11b-c5bd6b4cf6d4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:06.592846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e9869-b839-440e-b11b-c5bd6b4cf6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:06.592846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e9869-b839-440e-b11b-c5bd6b4cf6d4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:06.595088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 563/1124] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:06.601155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce7bf-be34-4218-9bfa-3c264122af9b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:06.601748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce7bf-be34-4218-9bfa-3c264122af9b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:06.601748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fce7bf-be34-4218-9bfa-3c264122af9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:06.631217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-70fce7bf-be34-4218-9bfa-3c264122af9b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:06.632877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-70fce7bf-be34-4218-9bfa-3c264122af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:06.672681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:06.706581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 562/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:06.970944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e9869-b839-440e-b11b-c5bd6b4cf6d4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:07.086030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e9869-b839-440e-b11b-c5bd6b4cf6d4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:07.123453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:07.124063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:07.124336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:07.124602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] PATH_INFO: `/v3/roles/056e13fdaccc4cef931d4ba13e6eafb1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:07.126063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] RBAC: Authorizing `identity:get_role(role_id=056e13fdaccc4cef931d4ba13e6eafb1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:07.127737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:07.129057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 564/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:06 2022] GET /identity/v3/roles/056e13fdaccc4cef931d4ba13e6eafb1 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:07.135086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce7bf-be34-4218-9bfa-3c264122af9b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:07.250613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fce7bf-be34-4218-9bfa-3c264122af9b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:07.286060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:07.286675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:07.286945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:07.287204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] PATH_INFO: `/v3/users/697fd3d630ab4f4bb1318652008a50bd` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:07.288435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] RBAC: Authorizing `identity:get_user(user_id=697fd3d630ab4f4bb1318652008a50bd)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:07.290040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:07.291612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 563/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:07 2022] GET /identity/v3/users/697fd3d630ab4f4bb1318652008a50bd => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:07.297831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:07.366947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:07.403280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5964ee-7923-4126-9501-66be69d42f7a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:07.440491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:07.441084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:07.441361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:07.441657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:07.509572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:07.510941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:07.576735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:07.619502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 565/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:25:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:25:07.625774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:07.674406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:07.732947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96b4fc-9281-4656-b1f4-926c2ba22f08 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:07.769317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01d3b9-378a-436a-8617-1376f421aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:07.769895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d3b9-378a-436a-8617-1376f421aefe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:07.770165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d3b9-378a-436a-8617-1376f421aefe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:07.770427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01d3b9-378a-436a-8617-1376f421aefe None admin] PATH_INFO: `/v3/projects/87c4617115eb4f509c486b9e700ef821` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:07.771581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01d3b9-378a-436a-8617-1376f421aefe None admin] RBAC: Authorizing `identity:get_project(project_id=87c4617115eb4f509c486b9e700ef821)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:07.773008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01d3b9-378a-436a-8617-1376f421aefe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:07.774776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 564/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:07 2022] GET /identity/v3/projects/87c4617115eb4f509c486b9e700ef821 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:07.781856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:07.896606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38aa2-ad23-40eb-b8de-19b208250af1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:07.932030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2cf14-b20f-4b0e-8145-c6a17b9b933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:07.932628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2cf14-b20f-4b0e-8145-c6a17b9b933e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:07.932906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2cf14-b20f-4b0e-8145-c6a17b9b933e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:07.933175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2cf14-b20f-4b0e-8145-c6a17b9b933e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:07.933949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2cf14-b20f-4b0e-8145-c6a17b9b933e None admin] RBAC: Adding query filter params (role.id=056e13fdaccc4cef931d4ba13e6eafb1, scope.project.id=87c4617115eb4f509c486b9e700ef821, user.id=697fd3d630ab4f4bb1318652008a50bd) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:07.934258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2cf14-b20f-4b0e-8145-c6a17b9b933e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:07.935707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2cf14-b20f-4b0e-8145-c6a17b9b933e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:07.941610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 566/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:25:07 2022] GET /identity/v3/role_assignments?user.id=697fd3d630ab4f4bb1318652008a50bd&scope.project.id=87c4617115eb4f509c486b9e700ef821&role.id=056e13fdaccc4cef931d4ba13e6eafb1 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:09.866811 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12359d-622a-4d68-85c3-f5819cfe2d9a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:09.867713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12359d-622a-4d68-85c3-f5819cfe2d9a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:09.867713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12359d-622a-4d68-85c3-f5819cfe2d9a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:09.869887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 565/1131] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:09.876145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92a564-ad93-4f05-bee9-41b97b8743bb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:09.876883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92a564-ad93-4f05-bee9-41b97b8743bb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:09.877356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92a564-ad93-4f05-bee9-41b97b8743bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:09.900389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fb92a564-ad93-4f05-bee9-41b97b8743bb None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:09.901583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fb92a564-ad93-4f05-bee9-41b97b8743bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:09.929151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:09.980338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 567/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:10.267116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12359d-622a-4d68-85c3-f5819cfe2d9a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:10.395380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12359d-622a-4d68-85c3-f5819cfe2d9a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:10.405065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:10.431569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2101b-c6ba-400d-b0ec-b3cc3773561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:10.432190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2101b-c6ba-400d-b0ec-b3cc3773561b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:10.432463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2101b-c6ba-400d-b0ec-b3cc3773561b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:10.432731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2101b-c6ba-400d-b0ec-b3cc3773561b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:10.433915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2101b-c6ba-400d-b0ec-b3cc3773561b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:10.435401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2101b-c6ba-400d-b0ec-b3cc3773561b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:10.437052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 566/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:25:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:10.443233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92a564-ad93-4f05-bee9-41b97b8743bb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:10.545614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92a564-ad93-4f05-bee9-41b97b8743bb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:10.580935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b124-5516-4178-a85b-bf6620c43cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:10.581523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b124-5516-4178-a85b-bf6620c43cfd None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:10.581836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b124-5516-4178-a85b-bf6620c43cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:10.582103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b124-5516-4178-a85b-bf6620c43cfd None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:10.582756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942b124-5516-4178-a85b-bf6620c43cfd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:10.584191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942b124-5516-4178-a85b-bf6620c43cfd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:10.615561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 568/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:25:10 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:25:12.518626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f868fa-6482-4d62-a0f0-75109db3bde8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:12.519515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f868fa-6482-4d62-a0f0-75109db3bde8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:12.519515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f868fa-6482-4d62-a0f0-75109db3bde8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:12.521932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 567/1135] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:12.527360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a295-4470-4b49-a997-5ff503364684 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:12.527809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a295-4470-4b49-a997-5ff503364684 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:12.527909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a295-4470-4b49-a997-5ff503364684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:12.547214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3c20a295-4470-4b49-a997-5ff503364684 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:12.548383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3c20a295-4470-4b49-a997-5ff503364684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:12.557772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:12.621486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 569/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:12.886132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f868fa-6482-4d62-a0f0-75109db3bde8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:13.007861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f868fa-6482-4d62-a0f0-75109db3bde8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:13.047393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0299a8-d6f7-421a-aee3-c7f184c225de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:13.048014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0299a8-d6f7-421a-aee3-c7f184c225de None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:13.048286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0299a8-d6f7-421a-aee3-c7f184c225de None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:13.048552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0299a8-d6f7-421a-aee3-c7f184c225de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:13.049809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0299a8-d6f7-421a-aee3-c7f184c225de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:13.051235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0299a8-d6f7-421a-aee3-c7f184c225de None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:13.052801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 568/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:25:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:13.059195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20a295-4470-4b49-a997-5ff503364684 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:13.163344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20a295-4470-4b49-a997-5ff503364684 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:13.199085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a1e22-74a9-44ba-b15c-f5a3277ed3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:13.199674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a1e22-74a9-44ba-b15c-f5a3277ed3f3 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:13.199946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a1e22-74a9-44ba-b15c-f5a3277ed3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:13.200210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a1e22-74a9-44ba-b15c-f5a3277ed3f3 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:13.200900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a1e22-74a9-44ba-b15c-f5a3277ed3f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:13.202340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a1e22-74a9-44ba-b15c-f5a3277ed3f3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:13.220704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:13.225928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 570/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:25:13 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:25:15.149254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65174e51-0930-4646-be25-41375207cfc0 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:15.149841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65174e51-0930-4646-be25-41375207cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:15.149841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65174e51-0930-4646-be25-41375207cfc0 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:15.151165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 569/1139] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:15.157390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb9d3-07e6-4f23-82d0-2cbaa31c2245 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:15.158158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb9d3-07e6-4f23-82d0-2cbaa31c2245 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:15.158331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb9d3-07e6-4f23-82d0-2cbaa31c2245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:15.181870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e3abb9d3-07e6-4f23-82d0-2cbaa31c2245 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:15.183054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e3abb9d3-07e6-4f23-82d0-2cbaa31c2245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:15.253413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 571/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:15.522979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65174e51-0930-4646-be25-41375207cfc0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:15.578285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:15.637478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65174e51-0930-4646-be25-41375207cfc0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:15.679312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:15.680193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:15.680559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:15.680925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:15.694550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:25:15.699260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:25:15.700386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:25:15.701435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 570/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:25:15.706848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abb9d3-07e6-4f23-82d0-2cbaa31c2245 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:15.810285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abb9d3-07e6-4f23-82d0-2cbaa31c2245 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:15.838840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:15.845494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:15.846128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:15.846406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:15.846675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:15.847336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:15.847634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:15.849010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:15.857071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 572/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:25:15.863605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:15.975149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d508e6-582a-410e-b68c-70ea540a9754 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:15.977915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:16.012372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:16.013054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:16.013346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:16.013635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] PATH_INFO: `/v3/users/26c2305574e547ada6b7d617b6e04b9a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:16.026323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] RBAC: Authorizing `identity:get_user(user_id=26c2305574e547ada6b7d617b6e04b9a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:16.027754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:16.029434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 571/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:15 2022] GET /identity/v3/users/26c2305574e547ada6b7d617b6e04b9a => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:16.035572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:16.157389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c53f9-de73-4f84-a38f-46e045f09738 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:16.200060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:16.200911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:16.201202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:16.201466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:16.262642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:16.275604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:16.277062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:16.384942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 573/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:25:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:25:16.391824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:16.495164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849e66-6f05-456d-ae9c-d243b76dd32d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:16.531422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e406fb-b856-41b7-8b57-f15d76a30b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:16.532041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e406fb-b856-41b7-8b57-f15d76a30b30 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:16.532315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e406fb-b856-41b7-8b57-f15d76a30b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:16.532580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e406fb-b856-41b7-8b57-f15d76a30b30 None admin] PATH_INFO: `/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:16.533833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e406fb-b856-41b7-8b57-f15d76a30b30 None admin] RBAC: Authorizing `identity:get_project(project_id=bf413272f0b04654ac03a61d6f1bf8e0)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:16.535251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e406fb-b856-41b7-8b57-f15d76a30b30 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:16.536891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 572/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:16 2022] GET /identity/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:16.543422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:16.639495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:16.655281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe032cf1-2b96-4a45-a40a-300ed8a66f69 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:16.696548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db1adb-364d-4a9f-8bf0-04a8a227af30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:16.697135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1adb-364d-4a9f-8bf0-04a8a227af30 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:16.697411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1adb-364d-4a9f-8bf0-04a8a227af30 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:16.697704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db1adb-364d-4a9f-8bf0-04a8a227af30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:16.698422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db1adb-364d-4a9f-8bf0-04a8a227af30 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=bf413272f0b04654ac03a61d6f1bf8e0, user.id=26c2305574e547ada6b7d617b6e04b9a) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:16.698722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db1adb-364d-4a9f-8bf0-04a8a227af30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:16.700146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db1adb-364d-4a9f-8bf0-04a8a227af30 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:16.705712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 574/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:25:16 2022] GET /identity/v3/role_assignments?user.id=26c2305574e547ada6b7d617b6e04b9a&scope.project.id=bf413272f0b04654ac03a61d6f1bf8e0&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:18.587057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18650b4f-d70b-49f5-81e9-647a3e327d2f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:18.587645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18650b4f-d70b-49f5-81e9-647a3e327d2f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:18.587645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18650b4f-d70b-49f5-81e9-647a3e327d2f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:18.589690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 573/1147] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:18.598285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9a7f-8e33-447b-8070-95e2fc977c80 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:18.598691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9a7f-8e33-447b-8070-95e2fc977c80 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:18.598847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9a7f-8e33-447b-8070-95e2fc977c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:18.626685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-770c9a7f-8e33-447b-8070-95e2fc977c80 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:18.628198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-770c9a7f-8e33-447b-8070-95e2fc977c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:18.703830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 575/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:18.965218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18650b4f-d70b-49f5-81e9-647a3e327d2f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:18.998977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:19.085594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18650b4f-d70b-49f5-81e9-647a3e327d2f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:19.120319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:19.120937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:19.121216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:19.121466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:19.131975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:25:19.136768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:25:19.137908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:25:19.138774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 574/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:25:19.147241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9a7f-8e33-447b-8070-95e2fc977c80 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:19.246018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:19.263546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9a7f-8e33-447b-8070-95e2fc977c80 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:19.301583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:19.302188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:19.302464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:19.302732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:19.303407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:19.303705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:19.305055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:19.313338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 576/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:25:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:19.322079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:19.427702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:19.438963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72260b5-2321-4541-bf62-246e96c65e45 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:19.473556 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:19.474189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:19.474465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:19.474727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] PATH_INFO: `/v3/users/26c2305574e547ada6b7d617b6e04b9a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:19.475855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] RBAC: Authorizing `identity:get_user(user_id=26c2305574e547ada6b7d617b6e04b9a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:19.477268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:19.478885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 575/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:19 2022] GET /identity/v3/users/26c2305574e547ada6b7d617b6e04b9a => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:19.485950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:19.605681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a5ca-0499-4f1f-9fb3-527b8b859eab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:19.641307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b1afb-b4cd-43cc-bf29-d4a6eff8a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:19.641956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1afb-b4cd-43cc-bf29-d4a6eff8a08f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:19.642232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1afb-b4cd-43cc-bf29-d4a6eff8a08f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:19.642503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1afb-b4cd-43cc-bf29-d4a6eff8a08f None admin] PATH_INFO: `/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:19.643746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b1afb-b4cd-43cc-bf29-d4a6eff8a08f None admin] RBAC: Authorizing `identity:get_project(project_id=bf413272f0b04654ac03a61d6f1bf8e0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:19.645195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b1afb-b4cd-43cc-bf29-d4a6eff8a08f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:19.646862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 577/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:19 2022] GET /identity/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:19.653069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:19.761200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e04217-3114-49d7-aa21-c6e39b949447 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:19.800122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb464a-baa1-47c9-845b-a7d68102e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:19.800764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb464a-baa1-47c9-845b-a7d68102e06e None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:19.801043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb464a-baa1-47c9-845b-a7d68102e06e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:19.801317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb464a-baa1-47c9-845b-a7d68102e06e None admin] PATH_INFO: `/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0/users/26c2305574e547ada6b7d617b6e04b9a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:19.803383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb464a-baa1-47c9-845b-a7d68102e06e None admin] RBAC: Authorizing `identity:create_grant(project_id=bf413272f0b04654ac03a61d6f1bf8e0, user_id=26c2305574e547ada6b7d617b6e04b9a, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:19.804805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb464a-baa1-47c9-845b-a7d68102e06e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:19.819790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 576/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:25:19 2022] PUT /identity/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0/users/26c2305574e547ada6b7d617b6e04b9a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:25:21.672795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e176a7e-1f1b-41f4-a691-ffbd116ebbd5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:21.673734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e176a7e-1f1b-41f4-a691-ffbd116ebbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:21.673734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e176a7e-1f1b-41f4-a691-ffbd116ebbd5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:21.675682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 578/1154] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:21.683545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620673aa-6e56-4803-868e-5fdce09ebd6b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:21.683991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620673aa-6e56-4803-868e-5fdce09ebd6b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:21.684083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620673aa-6e56-4803-868e-5fdce09ebd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:21.703107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-620673aa-6e56-4803-868e-5fdce09ebd6b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:21.704262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-620673aa-6e56-4803-868e-5fdce09ebd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:21.717794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:21.785007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 577/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:25:22.058036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e176a7e-1f1b-41f4-a691-ffbd116ebbd5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:22.084416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:22.179975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e176a7e-1f1b-41f4-a691-ffbd116ebbd5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:22.225584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:22.226222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:22.226501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:22.226773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:22.238329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:25:22.243146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:25:22.244222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:25:22.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 579/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:25:22.251784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620673aa-6e56-4803-868e-5fdce09ebd6b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:22.363771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620673aa-6e56-4803-868e-5fdce09ebd6b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:22.401022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:22.401655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:22.401934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:22.402204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:22.402871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:22.403175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:22.404603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:22.412840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 578/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:22.418954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:22.501429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:22.528742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233a055-f67c-42c7-95dd-8a647d04b015 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:22.562953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:22.563575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:22.563862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:22.564126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] PATH_INFO: `/v3/users/26c2305574e547ada6b7d617b6e04b9a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:22.565340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] RBAC: Authorizing `identity:get_user(user_id=26c2305574e547ada6b7d617b6e04b9a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:22.566806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:22.568386 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 580/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:22 2022] GET /identity/v3/users/26c2305574e547ada6b7d617b6e04b9a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:22.575518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:22.594869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:22.689878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c944e6b-4450-4c58-8610-b667a211910d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:22.727144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:22.727741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:22.728017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:22.728284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:22.804541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:22.806007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:22.817850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:22.908636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 579/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:25:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:25:22.915188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:23.021927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368dd3-7cd9-4433-89d0-a4db60022849 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:23.063610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514c47-c0bf-49e1-8d68-2caf8b670d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:23.064231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514c47-c0bf-49e1-8d68-2caf8b670d9a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:23.064511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514c47-c0bf-49e1-8d68-2caf8b670d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:23.064780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514c47-c0bf-49e1-8d68-2caf8b670d9a None admin] PATH_INFO: `/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:23.066072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e514c47-c0bf-49e1-8d68-2caf8b670d9a None admin] RBAC: Authorizing `identity:get_project(project_id=bf413272f0b04654ac03a61d6f1bf8e0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:23.067519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e514c47-c0bf-49e1-8d68-2caf8b670d9a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:23.069151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 581/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:22 2022] GET /identity/v3/projects/bf413272f0b04654ac03a61d6f1bf8e0 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:23.075519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:23.185654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dd4d5-7553-4205-b49b-895f26938c0d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:23.196888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:23.224368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277fdfa-0604-489c-bc9a-b6ffe268cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:23.224974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277fdfa-0604-489c-bc9a-b6ffe268cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:23.225247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277fdfa-0604-489c-bc9a-b6ffe268cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:23.225517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277fdfa-0604-489c-bc9a-b6ffe268cfe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:23.226274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277fdfa-0604-489c-bc9a-b6ffe268cfe2 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=bf413272f0b04654ac03a61d6f1bf8e0, user.id=26c2305574e547ada6b7d617b6e04b9a) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:23.226576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277fdfa-0604-489c-bc9a-b6ffe268cfe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:23.227996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277fdfa-0604-489c-bc9a-b6ffe268cfe2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:23.234005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 580/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:25:23 2022] GET /identity/v3/role_assignments?user.id=26c2305574e547ada6b7d617b6e04b9a&scope.project.id=bf413272f0b04654ac03a61d6f1bf8e0&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:25.136746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a88a6-a9f8-4ffa-9af9-66ee65f7664d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:25.137337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a88a6-a9f8-4ffa-9af9-66ee65f7664d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:25.137337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a88a6-a9f8-4ffa-9af9-66ee65f7664d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:25.138745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 582/1162] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:25.145179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe0ebf-da98-4ffb-b916-080b67b1e2fd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:25.145948 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe0ebf-da98-4ffb-b916-080b67b1e2fd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:25.146104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe0ebf-da98-4ffb-b916-080b67b1e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:25.173752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9efe0ebf-da98-4ffb-b916-080b67b1e2fd None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:25.174958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9efe0ebf-da98-4ffb-b916-080b67b1e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:25.246587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 581/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:25.510466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a88a6-a9f8-4ffa-9af9-66ee65f7664d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:25.528074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:25.637055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a88a6-a9f8-4ffa-9af9-66ee65f7664d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:25.674530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:25.675062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:25.675339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:25.675604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:25.756172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:25.757844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:25.771110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:25.860788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 583/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:25:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:25:25.867187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe0ebf-da98-4ffb-b916-080b67b1e2fd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:25.965598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe0ebf-da98-4ffb-b916-080b67b1e2fd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:25.967997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:26.010084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ccbc6-43f4-4880-8f7f-4ef39590ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:26.010700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccbc6-43f4-4880-8f7f-4ef39590ffec None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:26.010973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccbc6-43f4-4880-8f7f-4ef39590ffec None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:26.011239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ccbc6-43f4-4880-8f7f-4ef39590ffec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:26.018600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ccbc6-43f4-4880-8f7f-4ef39590ffec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:26.020054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ccbc6-43f4-4880-8f7f-4ef39590ffec None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-9e5ccbc6-43f4-4880-8f7f-4ef39590ffec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:25:26.031983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:25:26.033124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:25:26.034016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 582/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:25:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:25:26.039385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:26.144320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deceb15-972e-43bb-a36f-0a40fcc544ae None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:26.157465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:26.191709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150869-987c-4e33-9851-aaaf945bff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:26.192398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150869-987c-4e33-9851-aaaf945bff8d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:26.192687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150869-987c-4e33-9851-aaaf945bff8d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:26.193349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150869-987c-4e33-9851-aaaf945bff8d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:26.193579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150869-987c-4e33-9851-aaaf945bff8d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:26.193886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150869-987c-4e33-9851-aaaf945bff8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:26.195254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150869-987c-4e33-9851-aaaf945bff8d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:26.203226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 584/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Aug 30 00:25:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:28.061305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910dda3-db2a-4674-9423-0c74ac0738bc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:28.062253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910dda3-db2a-4674-9423-0c74ac0738bc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:28.062253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910dda3-db2a-4674-9423-0c74ac0738bc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:28.064423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 583/1167] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:28.072333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ed6b-3369-4a3c-9119-dd9ad962a805 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:28.072794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ed6b-3369-4a3c-9119-dd9ad962a805 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:28.072884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ed6b-3369-4a3c-9119-dd9ad962a805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:28.091868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2ef1ed6b-3369-4a3c-9119-dd9ad962a805 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:28.093038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ef1ed6b-3369-4a3c-9119-dd9ad962a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:28.163277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 585/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:25:28.427316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910dda3-db2a-4674-9423-0c74ac0738bc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:28.538559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910dda3-db2a-4674-9423-0c74ac0738bc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:28.575395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef03dd3-a411-4737-b9e4-6031a4e84bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:28.576009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03dd3-a411-4737-b9e4-6031a4e84bcb None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:28.576287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03dd3-a411-4737-b9e4-6031a4e84bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:28.576750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03dd3-a411-4737-b9e4-6031a4e84bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:28.577906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef03dd3-a411-4737-b9e4-6031a4e84bcb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:28.580156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef03dd3-a411-4737-b9e4-6031a4e84bcb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:28.599308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 584/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Tue Aug 30 00:25:28 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:25:30.512474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdb814-b888-44f3-a015-4c29e5337fe5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:30.513037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdb814-b888-44f3-a015-4c29e5337fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:30.513037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdb814-b888-44f3-a015-4c29e5337fe5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:30.514441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 586/1170] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:30.520632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baed3cf-6893-4eed-b0a1-ac07c6d20b38 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:30.521354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baed3cf-6893-4eed-b0a1-ac07c6d20b38 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:30.521492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baed3cf-6893-4eed-b0a1-ac07c6d20b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:30.544406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3baed3cf-6893-4eed-b0a1-ac07c6d20b38 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:30.545599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3baed3cf-6893-4eed-b0a1-ac07c6d20b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:30.565858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:30.626163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 585/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:30.889908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdb814-b888-44f3-a015-4c29e5337fe5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:31.000913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdb814-b888-44f3-a015-4c29e5337fe5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:31.008512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:31.038449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43aac7b-73e2-4108-aac4-72186506d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:31.039082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aac7b-73e2-4108-aac4-72186506d8ff None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:31.039360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aac7b-73e2-4108-aac4-72186506d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:31.039629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43aac7b-73e2-4108-aac4-72186506d8ff None admin] PATH_INFO: `/v3/domains/67551089131e4250817bcbc80a6dbcb3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:31.050912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aac7b-73e2-4108-aac4-72186506d8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=67551089131e4250817bcbc80a6dbcb3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:31.052359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43aac7b-73e2-4108-aac4-72186506d8ff None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:31.053988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 587/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Aug 30 00:25:30 2022] GET /identity/v3/domains/67551089131e4250817bcbc80a6dbcb3 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:31.060515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baed3cf-6893-4eed-b0a1-ac07c6d20b38 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:31.171114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baed3cf-6893-4eed-b0a1-ac07c6d20b38 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:31.206883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b17efc-c58d-4e64-a374-18c1349123d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:31.207472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17efc-c58d-4e64-a374-18c1349123d4 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:31.207746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17efc-c58d-4e64-a374-18c1349123d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:31.208007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b17efc-c58d-4e64-a374-18c1349123d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:31.208644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b17efc-c58d-4e64-a374-18c1349123d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:31.210093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b17efc-c58d-4e64-a374-18c1349123d4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:31.240064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 586/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:25:31 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:25:33.150452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53a83b-ba53-4ec4-9c2f-7fd72940676e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:33.151456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53a83b-ba53-4ec4-9c2f-7fd72940676e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:33.151456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53a83b-ba53-4ec4-9c2f-7fd72940676e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:33.153490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 588/1174] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:33.162177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104937de-b79c-4b8a-9368-63962ad2ea37 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:33.162959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104937de-b79c-4b8a-9368-63962ad2ea37 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:33.163123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104937de-b79c-4b8a-9368-63962ad2ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:33.179736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:33.186227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-104937de-b79c-4b8a-9368-63962ad2ea37 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:33.188286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-104937de-b79c-4b8a-9368-63962ad2ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:33.265119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 587/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:25:33.538320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53a83b-ba53-4ec4-9c2f-7fd72940676e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:33.658455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53a83b-ba53-4ec4-9c2f-7fd72940676e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:33.701873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a496d-9949-4293-bb8d-23e13c83ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:33.702743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a496d-9949-4293-bb8d-23e13c83ea9a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:33.703121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a496d-9949-4293-bb8d-23e13c83ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:33.703487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a496d-9949-4293-bb8d-23e13c83ea9a None admin] PATH_INFO: `/v3/domains/67551089131e4250817bcbc80a6dbcb3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:33.705303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a496d-9949-4293-bb8d-23e13c83ea9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=67551089131e4250817bcbc80a6dbcb3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:33.707566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a496d-9949-4293-bb8d-23e13c83ea9a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:33.710043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 589/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Aug 30 00:25:33 2022] GET /identity/v3/domains/67551089131e4250817bcbc80a6dbcb3 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:33.718353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104937de-b79c-4b8a-9368-63962ad2ea37 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:33.840645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104937de-b79c-4b8a-9368-63962ad2ea37 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:33.875612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681acb-1b57-4752-9840-e1ad83a39127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:33.876205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681acb-1b57-4752-9840-e1ad83a39127 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:33.876472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681acb-1b57-4752-9840-e1ad83a39127 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:33.877040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681acb-1b57-4752-9840-e1ad83a39127 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:33.877731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681acb-1b57-4752-9840-e1ad83a39127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:33.879145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681acb-1b57-4752-9840-e1ad83a39127 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:33.888343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:33.903438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 588/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:25:33 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:25:35.884772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0335c-ce31-4323-8c20-2f74b89f0b34 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:35.885738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0335c-ce31-4323-8c20-2f74b89f0b34 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:35.885738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0335c-ce31-4323-8c20-2f74b89f0b34 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:35.887755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 590/1178] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:35.895625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbc992-30cc-4b59-bc3d-b6cf8c1e0483 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:35.896076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbc992-30cc-4b59-bc3d-b6cf8c1e0483 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:35.896185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbc992-30cc-4b59-bc3d-b6cf8c1e0483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:35.916332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fddbc992-30cc-4b59-bc3d-b6cf8c1e0483 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:35.917510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fddbc992-30cc-4b59-bc3d-b6cf8c1e0483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:36.003635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 589/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:25:36.267589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0335c-ce31-4323-8c20-2f74b89f0b34 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:36.316983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:36.398023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0335c-ce31-4323-8c20-2f74b89f0b34 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:36.432822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:36.433441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:36.433746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:36.434015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:36.444430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:25:36.449123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:25:36.450402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:25:36.451565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 591/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:25:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:25:36.456747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbc992-30cc-4b59-bc3d-b6cf8c1e0483 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:36.560777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbc992-30cc-4b59-bc3d-b6cf8c1e0483 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:36.583574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:36.596190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:36.596790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:36.597070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:36.597343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:36.598045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:36.598349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:36.599716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:36.607560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 590/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:36.617810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:36.726220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:36.734521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f9ac-e40f-4e0c-abda-ebcc2ac7931c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:36.772178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:36.772796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:36.773071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:36.773344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] PATH_INFO: `/v3/users/bb7ee3d1ee524477ab056f7f764b1ae3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:36.787863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] RBAC: Authorizing `identity:get_user(user_id=bb7ee3d1ee524477ab056f7f764b1ae3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:36.789384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:36.791071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 592/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:36 2022] GET /identity/v3/users/bb7ee3d1ee524477ab056f7f764b1ae3 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:36.797430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:36.909288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044ebb-94a1-44ad-a333-1606ec1a7129 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:36.944288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:36.944882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:36.945158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:36.945426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:36.998002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:37.020774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:37.022966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:37.136914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 591/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:25:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:25:37.143408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:37.254740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508af7-2896-49fa-a760-ea998686ff2f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:37.293408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42880a-5a6c-485a-895d-c944350daab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:37.294068 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42880a-5a6c-485a-895d-c944350daab2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:37.294344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42880a-5a6c-485a-895d-c944350daab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:37.294618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42880a-5a6c-485a-895d-c944350daab2 None admin] PATH_INFO: `/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:37.295856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42880a-5a6c-485a-895d-c944350daab2 None admin] RBAC: Authorizing `identity:get_project(project_id=2ca6a095974741f8a1dc3c9ee1c48d12)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:37.297314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42880a-5a6c-485a-895d-c944350daab2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:37.298941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 593/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:37 2022] GET /identity/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:37.305502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:37.400561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:37.419341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddd1b9-e0d3-4949-9c03-2a9c1c87d8c7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:37.455715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e277fa8-bd8c-48b0-8217-d7e387189062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:37.456343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277fa8-bd8c-48b0-8217-d7e387189062 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:37.456631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277fa8-bd8c-48b0-8217-d7e387189062 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:37.456904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277fa8-bd8c-48b0-8217-d7e387189062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:37.457696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e277fa8-bd8c-48b0-8217-d7e387189062 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=2ca6a095974741f8a1dc3c9ee1c48d12, user.id=bb7ee3d1ee524477ab056f7f764b1ae3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:37.458017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e277fa8-bd8c-48b0-8217-d7e387189062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:37.459479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e277fa8-bd8c-48b0-8217-d7e387189062 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:37.465809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 592/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:25:37 2022] GET /identity/v3/role_assignments?user.id=bb7ee3d1ee524477ab056f7f764b1ae3&scope.project.id=2ca6a095974741f8a1dc3c9ee1c48d12&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:39.324796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7282a-6f63-4495-b899-ce8d149f6a83 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:39.325798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7282a-6f63-4495-b899-ce8d149f6a83 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:39.325798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7282a-6f63-4495-b899-ce8d149f6a83 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:39.328004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 594/1186] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:39.334277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cc2e-3489-4874-abe4-6748b07081fc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:39.334972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cc2e-3489-4874-abe4-6748b07081fc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:39.335145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40cc2e-3489-4874-abe4-6748b07081fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:39.363088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fa40cc2e-3489-4874-abe4-6748b07081fc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:39.364280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fa40cc2e-3489-4874-abe4-6748b07081fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:39.437512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 593/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:39.702333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7282a-6f63-4495-b899-ce8d149f6a83 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:39.729954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:39.819397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7282a-6f63-4495-b899-ce8d149f6a83 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:39.855278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:39.855895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:39.856169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:39.856513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:39.867420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:25:39.872185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:25:39.873267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:25:39.874226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 595/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:25:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:25:39.879984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40cc2e-3489-4874-abe4-6748b07081fc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:39.967318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:39.998825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40cc2e-3489-4874-abe4-6748b07081fc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:40.035630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:40.036223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:40.036495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:40.036756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:40.037406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:40.037728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:40.039082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:40.047838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 594/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:40.057521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:40.147376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:40.176733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4da2b-b029-43f5-8123-19f84b94b882 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:40.218936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:40.219502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:40.219779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:40.220049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] PATH_INFO: `/v3/users/bb7ee3d1ee524477ab056f7f764b1ae3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:40.221247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7ee3d1ee524477ab056f7f764b1ae3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:40.222727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:40.224295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 596/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:40 2022] GET /identity/v3/users/bb7ee3d1ee524477ab056f7f764b1ae3 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:40.233815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:40.349447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bbec-c7a2-43fa-895f-cc1bf0261fd9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:40.394328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b103fd-5e8b-4989-908d-3d7cb997848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:40.395285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b103fd-5e8b-4989-908d-3d7cb997848e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:40.395729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b103fd-5e8b-4989-908d-3d7cb997848e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:40.396148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b103fd-5e8b-4989-908d-3d7cb997848e None admin] PATH_INFO: `/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:40.398361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b103fd-5e8b-4989-908d-3d7cb997848e None admin] RBAC: Authorizing `identity:get_project(project_id=2ca6a095974741f8a1dc3c9ee1c48d12)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:40.400727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b103fd-5e8b-4989-908d-3d7cb997848e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:40.403975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 595/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:40 2022] GET /identity/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:40.412402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:40.533918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6f5e-4e73-4672-bd62-db182252bc53 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:40.571405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c1a7-9c90-4cc1-8fab-7d1f38c66423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:40.572051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c1a7-9c90-4cc1-8fab-7d1f38c66423 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:40.572333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c1a7-9c90-4cc1-8fab-7d1f38c66423 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:40.572587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c1a7-9c90-4cc1-8fab-7d1f38c66423 None admin] PATH_INFO: `/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12/users/bb7ee3d1ee524477ab056f7f764b1ae3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:40.574658 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c1a7-9c90-4cc1-8fab-7d1f38c66423 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6a095974741f8a1dc3c9ee1c48d12, user_id=bb7ee3d1ee524477ab056f7f764b1ae3, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:40.576101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c1a7-9c90-4cc1-8fab-7d1f38c66423 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:40.592013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 597/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:25:40 2022] PUT /identity/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12/users/bb7ee3d1ee524477ab056f7f764b1ae3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:25:42.457338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663eabf-34d6-4071-abc2-1bea6efda67a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:42.457960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663eabf-34d6-4071-abc2-1bea6efda67a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:42.457960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663eabf-34d6-4071-abc2-1bea6efda67a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:42.459233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 596/1193] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:25:42.465636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1e45-24df-422e-9616-061b42a1fe4c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:42.466071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1e45-24df-422e-9616-061b42a1fe4c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:42.466210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1e45-24df-422e-9616-061b42a1fe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:42.485383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4e4c1e45-24df-422e-9616-061b42a1fe4c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:25:42.486604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4e4c1e45-24df-422e-9616-061b42a1fe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:25:42.488658 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:42.558918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 598/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:25:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:25:42.823591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663eabf-34d6-4071-abc2-1bea6efda67a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:42.842970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:42.945380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663eabf-34d6-4071-abc2-1bea6efda67a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:42.980766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a256-6422-474d-8849-fbf796851986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:42.981425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a256-6422-474d-8849-fbf796851986 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:42.981740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a256-6422-474d-8849-fbf796851986 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:42.982010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a256-6422-474d-8849-fbf796851986 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:42.996579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298a256-6422-474d-8849-fbf796851986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5298a256-6422-474d-8849-fbf796851986 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:25:43.004747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:25:43.006628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:25:43.007461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 597/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:25:43.013351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1e45-24df-422e-9616-061b42a1fe4c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:43.113448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1e45-24df-422e-9616-061b42a1fe4c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:43.147753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:43.148360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:43.148634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:43.148900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:43.149623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:43.149918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:43.151282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:43.156211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:43.160043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 599/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:25:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:43.166110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a256-6422-474d-8849-fbf796851986 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:43.239138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:43.273558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a256-6422-474d-8849-fbf796851986 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:43.308536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:43.309150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:43.309468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:43.309761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] PATH_INFO: `/v3/users/bb7ee3d1ee524477ab056f7f764b1ae3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:43.310923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7ee3d1ee524477ab056f7f764b1ae3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:43.312336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:43.313928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 598/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Aug 30 00:25:43 2022] GET /identity/v3/users/bb7ee3d1ee524477ab056f7f764b1ae3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:43.320247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:43.425370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e7d18-72b5-407e-9327-e367a6118fe9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:43.465942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:43.466538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:43.466795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:43.467051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:43.536303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:43.539808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:43.542453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:43.651813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 600/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:25:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:25:43.660713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:43.765414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab3e5c-f829-408b-b906-95c5db681f73 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:43.803903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffcfe7-44c7-4b63-b747-08d10e5c01b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:43.804525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffcfe7-44c7-4b63-b747-08d10e5c01b4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:43.804800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffcfe7-44c7-4b63-b747-08d10e5c01b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:43.805064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffcfe7-44c7-4b63-b747-08d10e5c01b4 None admin] PATH_INFO: `/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:43.806245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffcfe7-44c7-4b63-b747-08d10e5c01b4 None admin] RBAC: Authorizing `identity:get_project(project_id=2ca6a095974741f8a1dc3c9ee1c48d12)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:43.807673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffcfe7-44c7-4b63-b747-08d10e5c01b4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:43.809321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 599/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Aug 30 00:25:43 2022] GET /identity/v3/projects/2ca6a095974741f8a1dc3c9ee1c48d12 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:43.818713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:25:43.915563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:43.918496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf64b42-e747-4804-883e-90af6ab81393 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:25:43.954706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71f7de-c9a6-4adc-81ab-13e1c349ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:25:43.955296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71f7de-c9a6-4adc-81ab-13e1c349ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:25:43.955577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71f7de-c9a6-4adc-81ab-13e1c349ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:25:43.955839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71f7de-c9a6-4adc-81ab-13e1c349ebe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:25:43.956565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71f7de-c9a6-4adc-81ab-13e1c349ebe9 None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=2ca6a095974741f8a1dc3c9ee1c48d12, user.id=bb7ee3d1ee524477ab056f7f764b1ae3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:25:43.956876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71f7de-c9a6-4adc-81ab-13e1c349ebe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:25:43.958319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71f7de-c9a6-4adc-81ab-13e1c349ebe9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:25:43.964347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 601/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:25:43 2022] GET /identity/v3/role_assignments?user.id=bb7ee3d1ee524477ab056f7f764b1ae3&scope.project.id=2ca6a095974741f8a1dc3c9ee1c48d12&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:25:53.798920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:25:53.961675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=18 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:39.488821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d80-fd50-4c81-a086-e61af0ed0938 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:39.489456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d80-fd50-4c81-a086-e61af0ed0938 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:39.489456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d80-fd50-4c81-a086-e61af0ed0938 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:39.491009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 600/1201] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:26:39.497945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a06a66-8bb2-4a30-9be2-245e1d948b48 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:39.498525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a06a66-8bb2-4a30-9be2-245e1d948b48 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:39.498525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a06a66-8bb2-4a30-9be2-245e1d948b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:39.518754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a1a06a66-8bb2-4a30-9be2-245e1d948b48 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:26:39.520144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a1a06a66-8bb2-4a30-9be2-245e1d948b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:39.621669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 602/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:26:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:26:39.906865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1d80-fd50-4c81-a086-e61af0ed0938 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:40.049928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1d80-fd50-4c81-a086-e61af0ed0938 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:40.103253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:40.104000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:40.104279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:40.104613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:40.117691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:40.119209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:40.140378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:40.142024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:40.143338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:40.143338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:40.143338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:40.143338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 601/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:40.148520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a06a66-8bb2-4a30-9be2-245e1d948b48 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:40.281276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a06a66-8bb2-4a30-9be2-245e1d948b48 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:40.317780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:40.324502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2766-9b23-49e7-849d-40d9e90a1835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:40.325093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2766-9b23-49e7-849d-40d9e90a1835 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:40.325364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2766-9b23-49e7-849d-40d9e90a1835 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:40.325648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2766-9b23-49e7-849d-40d9e90a1835 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:40.326285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2766-9b23-49e7-849d-40d9e90a1835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:40.326701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2766-9b23-49e7-849d-40d9e90a1835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:40.327970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2766-9b23-49e7-849d-40d9e90a1835 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:40.343074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 603/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:40.351716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:40.434968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:40.495692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e68df-8f21-4e17-bf16-de23cf759ef6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:40.548717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7bf9e-6fbd-4484-a631-6a49ba8fe6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:40.549304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bf9e-6fbd-4484-a631-6a49ba8fe6c8 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:40.549530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bf9e-6fbd-4484-a631-6a49ba8fe6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:40.549823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7bf9e-6fbd-4484-a631-6a49ba8fe6c8 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:40.550470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7bf9e-6fbd-4484-a631-6a49ba8fe6c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:40.551896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7bf9e-6fbd-4484-a631-6a49ba8fe6c8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:40.575411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 602/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Aug 30 00:26:40 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:26:42.676063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a532ed-dde2-47a9-bd8c-b21b728cac7e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:42.676784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a532ed-dde2-47a9-bd8c-b21b728cac7e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:42.676784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a532ed-dde2-47a9-bd8c-b21b728cac7e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:42.677967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 604/1206] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:26:42.683454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ae46-0c7c-4507-a6e6-58c7d1c225ee None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:42.683952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ae46-0c7c-4507-a6e6-58c7d1c225ee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:42.684040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ae46-0c7c-4507-a6e6-58c7d1c225ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:42.703939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7f91ae46-0c7c-4507-a6e6-58c7d1c225ee None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:26:42.705181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7f91ae46-0c7c-4507-a6e6-58c7d1c225ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:42.785220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 603/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:26:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:26:43.061993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a532ed-dde2-47a9-bd8c-b21b728cac7e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:43.194171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a532ed-dde2-47a9-bd8c-b21b728cac7e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:43.239423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:43.240108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:43.240308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:43.240573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:43.253414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:26:43.258391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:43.259428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:43.260260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 605/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:43.265783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91ae46-0c7c-4507-a6e6-58c7d1c225ee None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:43.312478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:43.388898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91ae46-0c7c-4507-a6e6-58c7d1c225ee None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:43.430548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:43.431190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:43.431468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:43.431774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:43.432448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:43.432747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:43.434200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:43.443344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 604/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:43.449036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:43.508814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:43.568283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0ffa-6ee8-4c82-8f7d-c6aa25329e3b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:43.604819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:43.605473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:43.605773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:43.606049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:43.617815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:43.619317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:43.634479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:43.635675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:43.641690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:43.641690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:43.641690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:43.641690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 606/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:26:43.641983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:43.752354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:43.757171 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49186-309e-414b-85cb-72f903c229ce None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:43.795073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:43.796066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:43.796517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:43.796781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:43.797429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:43.797773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:43.799503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:43.816265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 605/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:26:43.823471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:43.929232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa437-ecc8-4449-a064-3c47002f7257 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:43.931145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:43.975423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:43.976184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:43.976459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:43.976720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:43.985626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:43.987275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:26:43.998595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:43.999995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:44.001564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:44.004837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 607/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:44.006000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:44.119239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92177c8-e2c8-4569-96f0-d5a52e1285f5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:44.159607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:44.160397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:44.160663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:44.160939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:44.161865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:44.162215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:44.163737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:44.183742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 606/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 30 00:26:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:26:44.189880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:44.307978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af569-ab29-435c-9177-41365edffc9b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:44.346653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:44.347284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:44.347551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:44.347821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:44.382096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:44.426825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:44.428705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:44.551454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 608/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:26:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:26:44.556990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:44.576902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:44.669678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5cc7d-de42-4fac-91ef-23b559c1f354 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:44.706451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:44.707088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:44.707368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:44.707676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:44.718258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:44.719726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:44.734997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:44.736149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:44.737380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:44.737380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:44.737380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:44.737380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 607/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:44.742440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:44.824379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:44.866109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e8233-f861-4b5f-8c08-afbd4bb7d709 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:44.904988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:44.905963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:44.906336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:44.906893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:44.907947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:44.908436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:44.909998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:44.925340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 609/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:26:44.931190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:45.012403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:45.049808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894b5ba-ec85-400f-84d3-98ca56b7f770 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:45.088156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:45.088792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:45.089067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:45.089338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:45.096632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:45.098592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:26:45.110544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:45.111729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:45.112784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 608/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:26:45.118982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:45.239548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51781-9f8e-4042-99e8-e0ce0144ddae None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:45.269662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:45.282590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcf85f-625b-467c-ad5d-3e5be7e00fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:45.283332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcf85f-625b-467c-ad5d-3e5be7e00fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:45.283834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcf85f-625b-467c-ad5d-3e5be7e00fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:45.284153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcf85f-625b-467c-ad5d-3e5be7e00fc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:45.285060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcf85f-625b-467c-ad5d-3e5be7e00fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:45.285453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcf85f-625b-467c-ad5d-3e5be7e00fc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:45.287202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcf85f-625b-467c-ad5d-3e5be7e00fc1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:45.304876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 610/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:45.307262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:45.434854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b537-95de-4a6c-973b-e03c9a8939f9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:45.471468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:45.479501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caf6ea-290d-48a9-87d1-5e4e2ad18037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:45.480142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caf6ea-290d-48a9-87d1-5e4e2ad18037 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:45.480437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caf6ea-290d-48a9-87d1-5e4e2ad18037 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:45.480779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caf6ea-290d-48a9-87d1-5e4e2ad18037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:45.481612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caf6ea-290d-48a9-87d1-5e4e2ad18037 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=ab238ea3e0614e92a53cda1b0fc413f8) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:45.481926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caf6ea-290d-48a9-87d1-5e4e2ad18037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:45.483531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caf6ea-290d-48a9-87d1-5e4e2ad18037 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:45.501668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 609/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:26:45 2022] GET /identity/v3/role_assignments?user.id=ab238ea3e0614e92a53cda1b0fc413f8&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:47.464150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a37d-6e46-4a51-b7fd-5e21e4948135 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:47.464748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a37d-6e46-4a51-b7fd-5e21e4948135 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:47.464748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35a37d-6e46-4a51-b7fd-5e21e4948135 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:47.466102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 611/1220] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:26:47.471498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750519d-0743-4ff8-8da7-a83a0847b2ad None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:47.471958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750519d-0743-4ff8-8da7-a83a0847b2ad None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:47.472068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750519d-0743-4ff8-8da7-a83a0847b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:47.491165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a750519d-0743-4ff8-8da7-a83a0847b2ad None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:26:47.492468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a750519d-0743-4ff8-8da7-a83a0847b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:47.573582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 610/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:26:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:26:47.846582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35a37d-6e46-4a51-b7fd-5e21e4948135 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:47.963862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35a37d-6e46-4a51-b7fd-5e21e4948135 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:48.001685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:48.002346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:48.002639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:48.002888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:48.014302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:26:48.019190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:48.020412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:48.021748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 612/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:48.026913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750519d-0743-4ff8-8da7-a83a0847b2ad None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:48.134981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750519d-0743-4ff8-8da7-a83a0847b2ad None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:48.160532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:48.172501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:48.173156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:48.173408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:48.173701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:48.174428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:48.174810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:48.176224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:48.185355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 611/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:26:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:48.191887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:48.240421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:48.302458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4005516-e680-4713-a9d3-c14b03942c32 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:48.340091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:48.340801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:48.341017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:48.341283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:48.353011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:48.354687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:48.371227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:48.372655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:48.373966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:48.373966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:48.373966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:48.373966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 613/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:48.379422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:48.488362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db0276-789f-410d-97d8-d0d06ee4a460 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:48.526605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:48.527216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:48.527494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:48.527759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:48.528407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:48.528699 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:48.530153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:48.542652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 612/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:48.548499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:48.664197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:48.671853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc815ad6-61f1-4d4b-a246-b59301c838a2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:48.711745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:48.712433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:48.712716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:48.712986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:48.722284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:48.723960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:26:48.737074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:48.738309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:48.744565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 614/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:48.746523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:48.803953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:48.872440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08719fa6-3505-4556-be2e-09968be1bca5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:48.909871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:48.910530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:48.910809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:48.911073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:48.911859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:48.912152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:48.913670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:48.932180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 613/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 30 00:26:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:48.938613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:49.062569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06421d71-c585-49aa-92c8-0d3aacbe442d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:49.098038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:49.098676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:49.098954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:49.099223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:49.110028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:49.111474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:49.128072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:49.134618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:49.135773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:49.135773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:49.135773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:49.135773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 615/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:49.137360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:49.251142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccfc72-0c32-4beb-b075-d69c44061d7a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:49.253565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:49.289226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:49.290572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:49.292099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:49.292461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:49.293064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:49.293365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:49.294765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:49.306783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 614/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:49.312906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:49.322796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:49.425027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a748407-4811-442d-bd18-02288adccf02 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:49.460953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:49.461624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:49.461911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:49.462180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:49.469653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:49.471281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:26:49.482864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:49.484055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:49.485154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:49.487080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 616/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:26:49.493232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:49.611586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11173eb-9258-47fd-ba3b-73c14317b552 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:49.647314 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a28e3-02eb-4294-be97-2d1ea323dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:49.647955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a28e3-02eb-4294-be97-2d1ea323dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:49.648250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a28e3-02eb-4294-be97-2d1ea323dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:49.648496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a28e3-02eb-4294-be97-2d1ea323dbf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:49.649209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a28e3-02eb-4294-be97-2d1ea323dbf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:49.649514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a28e3-02eb-4294-be97-2d1ea323dbf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:49.651052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a28e3-02eb-4294-be97-2d1ea323dbf9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:49.664853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 615/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:26:49.671264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:49.740873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:49.778634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcc261-3fe9-4dd6-9aa9-acdfb98d0028 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:49.827781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b979e7-1f8c-4da0-b845-b71f31bbbd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:49.829178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b979e7-1f8c-4da0-b845-b71f31bbbd96 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:49.829861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b979e7-1f8c-4da0-b845-b71f31bbbd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:49.830390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b979e7-1f8c-4da0-b845-b71f31bbbd96 None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/ab238ea3e0614e92a53cda1b0fc413f8/roles/fd92aa943af04a3c8616b3cb3138ece2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:49.853845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b979e7-1f8c-4da0-b845-b71f31bbbd96 None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=ab238ea3e0614e92a53cda1b0fc413f8, role_id=fd92aa943af04a3c8616b3cb3138ece2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:49.856081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b979e7-1f8c-4da0-b845-b71f31bbbd96 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:49.872318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 617/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:26:49 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/ab238ea3e0614e92a53cda1b0fc413f8/roles/fd92aa943af04a3c8616b3cb3138ece2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:26:51.890635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeba46-955c-448c-8232-17be55a6ddd0 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:51.891232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeba46-955c-448c-8232-17be55a6ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:51.891232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeba46-955c-448c-8232-17be55a6ddd0 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:51.892732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 616/1233] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:26:51.898354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8b3c1-8fb5-4670-bafa-43560e70341f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:51.898786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8b3c1-8fb5-4670-bafa-43560e70341f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:51.898907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8b3c1-8fb5-4670-bafa-43560e70341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:51.928090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d6b8b3c1-8fb5-4670-bafa-43560e70341f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:26:51.929330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d6b8b3c1-8fb5-4670-bafa-43560e70341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:52.013332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 618/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:26:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:26:52.301528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeba46-955c-448c-8232-17be55a6ddd0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:52.332062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:52.422245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeba46-955c-448c-8232-17be55a6ddd0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:52.460292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:52.460980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:52.461189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:52.461460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:52.472765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:26:52.477702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:52.481609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:52.482823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 617/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Aug 30 00:26:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:52.485592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8b3c1-8fb5-4670-bafa-43560e70341f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:52.537745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:52.597240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8b3c1-8fb5-4670-bafa-43560e70341f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:52.634333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:52.634946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:52.635225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:52.635496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:52.637004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:52.637392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:52.639027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:52.647867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 619/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Aug 30 00:26:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:52.654302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:52.752933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:52.770775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ba81-b215-4a76-9b02-3ace7684f3e3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:52.811212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:52.812203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:52.812449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:52.812720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:52.826659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:52.828423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:52.845136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:52.846500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:52.847507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:52.847507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:52.847507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:52.847507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 618/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:52.853967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:52.966496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8f9ce-4be8-4daa-9571-cb93e3edb9ac None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:52.976349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:53.005215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:53.005861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:53.007283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:53.007283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:53.007283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:53.007596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:53.008783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:53.021494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 620/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:53.027333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:53.141305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c7da-c5f6-4aad-a17f-6d81d2a6c386 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:53.184655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:53.185301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:53.185681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:53.186037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:53.189066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:53.195293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:53.196931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:26:53.210410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:53.211688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:53.212877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 619/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:26:53.218490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:53.349412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24399a-21dd-4e1b-8904-e6b9f2fc5b08 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:53.391206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:53.391917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:53.392275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:53.392402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:53.393149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:53.393452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:53.394974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:53.413766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 621/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 30 00:26:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:53.419901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:53.526499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57864b-ec7c-4d94-8cd0-8ef94e3142ae None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:53.564634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:53.565387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:53.565744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:53.566039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:53.632891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:53.640341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:53.641827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:53.752324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 620/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:26:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:26:53.759482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:53.795163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:53.883362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e5abf-fda6-4845-b950-de1d15bd2402 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:53.921083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:53.921760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:53.922041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:53.922311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:53.932682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:53.934178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:53.950223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:53.951378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:53.954561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:53.954561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:53.954561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:53.954561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 622/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:53.958037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:54.073677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:54.080548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cccf3-e63a-44b7-82b6-26228ff8c272 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:54.119216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:54.119884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:54.120149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:54.120414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:54.121070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:54.121365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:54.122821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:54.135538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 621/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:54.142004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:54.236678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:54.262377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65db2e-3fb6-49f9-b567-5923e7b00132 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:54.300536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:54.301176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:54.301462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:54.301784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:54.309143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:54.310874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:26:54.324129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:54.325346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:54.326293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 623/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:54.331938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:54.441410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ec61-c2c1-45dc-8d3f-cb1b495a2760 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:54.481860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503229-1b9c-4f1d-931f-15cb0059986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:54.482538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503229-1b9c-4f1d-931f-15cb0059986f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:54.482879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503229-1b9c-4f1d-931f-15cb0059986f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:54.483186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503229-1b9c-4f1d-931f-15cb0059986f None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:54.483925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503229-1b9c-4f1d-931f-15cb0059986f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:54.484236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503229-1b9c-4f1d-931f-15cb0059986f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:54.485784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503229-1b9c-4f1d-931f-15cb0059986f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:54.498651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 622/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:54.505534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:54.616900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c6633-c7fa-4d2b-8dfb-96af90da5070 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:54.655207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bfe65-d40b-4d70-942f-cff565fb1585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:54.655817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bfe65-d40b-4d70-942f-cff565fb1585 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:54.656116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bfe65-d40b-4d70-942f-cff565fb1585 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:54.656458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bfe65-d40b-4d70-942f-cff565fb1585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:54.657215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bfe65-d40b-4d70-942f-cff565fb1585 None admin] RBAC: Adding query filter params (role.id=fd92aa943af04a3c8616b3cb3138ece2, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=ab238ea3e0614e92a53cda1b0fc413f8) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:54.657523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bfe65-d40b-4d70-942f-cff565fb1585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:54.659413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bfe65-d40b-4d70-942f-cff565fb1585 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:54.665320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 624/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:26:54 2022] GET /identity/v3/role_assignments?user.id=ab238ea3e0614e92a53cda1b0fc413f8&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=fd92aa943af04a3c8616b3cb3138ece2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:56.997856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6feba6-c48a-4da4-b83a-4dee8c9ffe86 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:56.998492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6feba6-c48a-4da4-b83a-4dee8c9ffe86 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:56.998492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6feba6-c48a-4da4-b83a-4dee8c9ffe86 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:56.999890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 623/1247] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:26:57.006839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a32b0-ddbe-48ef-b2c9-663ccd84ebf0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:57.007429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a32b0-ddbe-48ef-b2c9-663ccd84ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:57.007429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a32b0-ddbe-48ef-b2c9-663ccd84ebf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:57.014876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:57.028749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a76a32b0-ddbe-48ef-b2c9-663ccd84ebf0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:26:57.030208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a76a32b0-ddbe-48ef-b2c9-663ccd84ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:57.106938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 625/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:26:57.385404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6feba6-c48a-4da4-b83a-4dee8c9ffe86 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:57.408846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:57.511637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6feba6-c48a-4da4-b83a-4dee8c9ffe86 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:57.549153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:57.549837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:57.550098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:57.550372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:57.561213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:26:57.566220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:57.567406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:57.568335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 624/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:57.574465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a32b0-ddbe-48ef-b2c9-663ccd84ebf0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:57.702121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a32b0-ddbe-48ef-b2c9-663ccd84ebf0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:57.736395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:57.743018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:57.743768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:57.744129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:57.744494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:57.745209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:57.745515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:57.746962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:57.757312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 626/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:26:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:26:57.763256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:57.856095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:57.882222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f269bde-4bc2-41e7-8220-82e0b3841215 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:57.921239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:57.921925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:57.922205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:57.922474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:57.934440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:57.936168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:57.955102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:57.956249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:57.957284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:57.957284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:57.957284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:57.957284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 625/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:57.962509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:58.070962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0847c-a0e4-4b44-8ddf-3f7512a60e2f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:58.107585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:58.108263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:58.108514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:58.108782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:58.109426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:58.109763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:58.111136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:58.123634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 627/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:58.130105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:58.246677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04ffe9-2051-4d1f-b45e-2b217679e0bc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:58.274430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:58.286999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:58.288121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:58.288470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:58.288837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:58.306038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:58.307508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:26:58.319046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:58.320164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:26:58.321214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 626/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:58.326256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:58.390231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:58.439648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668b2fc-9119-430a-97ed-937df006ca68 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:58.478596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:58.479243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:58.479540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:58.479814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:58.480578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:58.480911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:58.482414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:58.502461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 628/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 30 00:26:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:58.510307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:58.617892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5775d7-0b6d-410c-a418-eb1542091d80 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:58.651800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:58.652408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:58.652699 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:58.652951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:58.712969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:58.725801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:58.727295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:58.837023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 627/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:26:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:26:58.843189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:58.949359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beace3c-c22c-41a4-9849-9b2d744c2324 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:58.963655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:58.987449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:58.988172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:58.988482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:58.988748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:58.999899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:59.001948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:26:59.017336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:59.018376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:26:59.019254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:26:59.019254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:26:59.019254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:59.019254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 629/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:26:59.024312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:59.115170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:59.130149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b11d-fae8-473b-9c0e-18a3132fe4c6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:59.165368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:59.166000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:59.166277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:59.166593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:59.167191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:59.167549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:59.168932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:59.181312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 628/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:59.187323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:59.308777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa391e0-3e52-442d-9f0f-d2533541bd36 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:59.348147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:59.348858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:59.349165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:59.349504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:59.358343 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:59.360000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:26:59.375108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:26:59.376863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:26:59.377963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:26:59.378413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 630/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:26:59.385191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:59.501624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866c9d-d7ad-4d22-b87d-6d3d85d80fff None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:59.537855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d674483-004c-4836-bbd7-e0aeeac5c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:59.538458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d674483-004c-4836-bbd7-e0aeeac5c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:59.538729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d674483-004c-4836-bbd7-e0aeeac5c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:59.538992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d674483-004c-4836-bbd7-e0aeeac5c9a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:59.539675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d674483-004c-4836-bbd7-e0aeeac5c9a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:59.539970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d674483-004c-4836-bbd7-e0aeeac5c9a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:59.541823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d674483-004c-4836-bbd7-e0aeeac5c9a0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:59.553887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 629/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:26:59.560352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:59.589931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:59.671563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ce79-4991-4a76-bbf2-b990ca98a402 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:59.709156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823180a-9329-4280-92c0-5a9fae10769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:59.709829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823180a-9329-4280-92c0-5a9fae10769a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:59.710110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823180a-9329-4280-92c0-5a9fae10769a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:59.710382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823180a-9329-4280-92c0-5a9fae10769a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:59.711214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823180a-9329-4280-92c0-5a9fae10769a None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=ab238ea3e0614e92a53cda1b0fc413f8) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:26:59.711546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823180a-9329-4280-92c0-5a9fae10769a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:59.713029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823180a-9329-4280-92c0-5a9fae10769a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:59.719539 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 631/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:26:59 2022] GET /identity/v3/role_assignments?user.id=ab238ea3e0614e92a53cda1b0fc413f8&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:27:01.624434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a4b3-f5ed-4c01-a972-e4d501d6f7ca None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:01.625708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a4b3-f5ed-4c01-a972-e4d501d6f7ca None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:01.625708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a4b3-f5ed-4c01-a972-e4d501d6f7ca None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:01.627687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 630/1261] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:27:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:27:01.635563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29b78-b052-4058-b118-35fdf137d3c7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:01.636002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29b78-b052-4058-b118-35fdf137d3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:01.636123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29b78-b052-4058-b118-35fdf137d3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:01.656083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e2e29b78-b052-4058-b118-35fdf137d3c7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:27:01.657190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e2e29b78-b052-4058-b118-35fdf137d3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:01.730338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 632/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:27:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:27:02.002253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a4b3-f5ed-4c01-a972-e4d501d6f7ca None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:02.020684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:02.117834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a4b3-f5ed-4c01-a972-e4d501d6f7ca None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:02.154242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:02.154913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:02.155189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:02.155450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:02.166435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:27:02.171247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:02.172334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:27:02.173183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 631/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:02.178554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29b78-b052-4058-b118-35fdf137d3c7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:02.198472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:02.288995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29b78-b052-4058-b118-35fdf137d3c7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:02.324947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:02.325578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:02.325854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:02.326143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:02.326865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:02.327139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:02.328533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:02.343565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 633/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:02.353883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:02.430870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:02.465708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd4cd-331d-479f-be3d-412b1177b58b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:02.502917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:02.503543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:02.503820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:02.504089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:02.515891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:02.517335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:27:02.531562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:02.532623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:27:02.533703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:27:02.533703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:02.533703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:27:02.533703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 632/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:02.538932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:02.643015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:02.664642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66107965-45fd-4188-a7ae-2f49933ef992 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:02.702731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:02.703333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:02.703608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:02.703873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:02.704509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:02.704808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:02.706211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:02.719143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 634/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:02.725133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:02.831756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255f0c-11f0-48f4-9bbb-ca032c78ee55 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:02.861166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:02.882489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:02.883215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:02.883545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:02.883832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:02.891759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:02.893266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:27:02.904629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:02.905785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:27:02.906786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 633/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:27:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:02.912093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:03.031813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e4b1-0a4b-4e66-8082-23484aeaded9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:03.067015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:03.067631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:03.067902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:03.068163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:03.068995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:03.069287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:03.070745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:03.080150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:03.089677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 635/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 30 00:27:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:03.096064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:03.219531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7915a-4e99-4a7a-88f6-0f61627b6894 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:03.262093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:03.262736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:03.263018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:03.263290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:03.275269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:03.276768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:27:03.292479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:03.293693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:27:03.295534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:27:03.295534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:03.295534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:27:03.295534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 634/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:03.302707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:03.427203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9627ec-8c18-4e3e-bcb6-37bbc6788a46 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:03.474804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:03.475344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:03.475622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:03.475890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:03.476555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:03.476882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:03.478309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:03.490410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 636/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:03.500829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:03.536063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:03.621801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c71038-da5f-4c22-ac0e-23f03a0aa7fd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:03.661101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:03.661756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:03.662032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:03.662341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:03.670460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:03.672036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:27:03.684828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:03.685882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:27:03.687102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 635/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:03.693168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:03.764614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:03.808008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4668c-a1fb-423c-a8f5-d3c6a2f8120f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:03.843374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f0da-6dff-4d1d-8e9a-4762a78595a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:03.843971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f0da-6dff-4d1d-8e9a-4762a78595a0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:03.844246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f0da-6dff-4d1d-8e9a-4762a78595a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:03.844516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f0da-6dff-4d1d-8e9a-4762a78595a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:03.845208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f0da-6dff-4d1d-8e9a-4762a78595a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:03.845511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f0da-6dff-4d1d-8e9a-4762a78595a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:03.846974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f0da-6dff-4d1d-8e9a-4762a78595a0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:03.859026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 637/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:03.865215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:03.957100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:03.967435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa094c-bbd0-4890-8524-545d7f327e92 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:04.003833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a724d-dc81-4c0b-afba-69957ebeaa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:04.004477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a724d-dc81-4c0b-afba-69957ebeaa35 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:04.004752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a724d-dc81-4c0b-afba-69957ebeaa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:04.005022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a724d-dc81-4c0b-afba-69957ebeaa35 None admin] PATH_INFO: `/v3/projects/20646077df5b45409498a71f7787f6e7/users/ab238ea3e0614e92a53cda1b0fc413f8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:04.006947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a724d-dc81-4c0b-afba-69957ebeaa35 None admin] RBAC: Authorizing `identity:create_grant(project_id=20646077df5b45409498a71f7787f6e7, user_id=ab238ea3e0614e92a53cda1b0fc413f8, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:04.008370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a724d-dc81-4c0b-afba-69957ebeaa35 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:04.024213 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 636/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Aug 30 00:27:03 2022] PUT /identity/v3/projects/20646077df5b45409498a71f7787f6e7/users/ab238ea3e0614e92a53cda1b0fc413f8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:27:05.912963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7011-5755-4abd-863f-1841e4c16da8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:05.913652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7011-5755-4abd-863f-1841e4c16da8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:05.913652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b7011-5755-4abd-863f-1841e4c16da8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:05.914919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 638/1274] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:27:05.921286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e209cc-82e5-4944-913e-7ccdeec92b3c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:05.922090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e209cc-82e5-4944-913e-7ccdeec92b3c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:05.922231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e209cc-82e5-4944-913e-7ccdeec92b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:05.947393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-37e209cc-82e5-4944-913e-7ccdeec92b3c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:27:05.948578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-37e209cc-82e5-4944-913e-7ccdeec92b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:06.027264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 637/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:27:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:27:06.295162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b7011-5755-4abd-863f-1841e4c16da8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:06.406319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b7011-5755-4abd-863f-1841e4c16da8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:06.423508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:06.441269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:06.442000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:06.442275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:06.442544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:06.453684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:27:06.458631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:06.459862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:06.460780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 639/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Aug 30 00:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:06.466136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e209cc-82e5-4944-913e-7ccdeec92b3c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:06.551518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:06.572631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e209cc-82e5-4944-913e-7ccdeec92b3c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:06.612158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:06.612767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:06.613029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:06.613298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:06.614014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:06.614317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:06.615699 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:06.624422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 638/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Aug 30 00:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:06.631347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:06.753838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07821-13e2-43e9-9c3e-1dde2c7410ba None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:06.793917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:06.794808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:06.795212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:06.795607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:06.807339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:06.809122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:27:06.826893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:06.828055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:27:06.829018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:27:06.829018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:06.829018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:06.829018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 640/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:06.835375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:06.942195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580c954-aacd-448d-b206-ccf518efe9b4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:06.976537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:06.977140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:06.977408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:06.977706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:06.978346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:06.978638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:06.979991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:06.991785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 639/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:06.997963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:07.030760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:07.102807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a035-9aab-4f13-bd0a-d45876518470 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:07.137257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:07.137909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:07.138185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:07.138455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:07.145950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:07.148581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:27:07.159339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:07.160448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:07.161688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 641/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:27:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:07.167264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:07.173344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:07.288736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a790506-7598-4865-bc9d-5b4558131eee None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:07.328700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:07.329306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:07.329589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:07.329881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:07.330615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:07.330919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:07.332371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:07.351571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 640/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Aug 30 00:27:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:07.360254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:07.471268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:07.482448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906800d9-b8bb-408e-8db4-37f52c632858 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:07.520078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:07.520684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:07.520955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:07.521213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:07.590856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:07.592315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:07.684976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:07.697340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 642/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Aug 30 00:27:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:27:07.705324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:07.772641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:07.828845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a06df3-f1a3-45fb-ae9b-4e6fd114a41f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:07.864292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:07.864904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:07.865181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:07.865444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:07.876186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:07.877682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:27:07.892201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:07.893263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:27:07.894386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:27:07.894386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:27:07.894386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:27:07.894386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 641/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:07.899925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:08.002194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e0c1a-6903-40bf-93ee-763504c38ad7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:08.037807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:08.038398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:08.038672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:08.038943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:08.039580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:08.039881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:08.041268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:08.052710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 643/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Aug 30 00:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:08.058888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:08.165869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9e732-1f4d-48eb-adc1-140b5ed2293c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:08.179664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:08.202981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:08.203634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:08.203907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:08.204183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:08.210887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:08.212327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:27:08.223549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:08.224607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Aug 30 00:27:08.225533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 642/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Aug 30 00:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:08.230827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:08.285169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:08.340106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d567f17-b4b6-42d4-a6f4-38859ca08340 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:08.375535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303c18b-6d99-4a9f-80ae-fbf062b9ff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:08.376149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303c18b-6d99-4a9f-80ae-fbf062b9ff45 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:08.376424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303c18b-6d99-4a9f-80ae-fbf062b9ff45 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:08.376696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303c18b-6d99-4a9f-80ae-fbf062b9ff45 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:08.377419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303c18b-6d99-4a9f-80ae-fbf062b9ff45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:08.377755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303c18b-6d99-4a9f-80ae-fbf062b9ff45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:08.379227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303c18b-6d99-4a9f-80ae-fbf062b9ff45 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:08.393897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 644/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Aug 30 00:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:08.400383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:08.508476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be71a-6380-422d-a9f4-e1e251b90ccb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:08.544555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e19b4-2011-4acc-9150-644a0ebbfb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:08.545115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e19b4-2011-4acc-9150-644a0ebbfb7f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:08.545393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e19b4-2011-4acc-9150-644a0ebbfb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:08.545692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e19b4-2011-4acc-9150-644a0ebbfb7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:08.546508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e19b4-2011-4acc-9150-644a0ebbfb7f None admin] RBAC: Adding query filter params (role.id=e97e5b9bfc8841a3ba7acb15d8e9c023, scope.project.id=20646077df5b45409498a71f7787f6e7, user.id=ab238ea3e0614e92a53cda1b0fc413f8) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:08.546810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e19b4-2011-4acc-9150-644a0ebbfb7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:08.548266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e19b4-2011-4acc-9150-644a0ebbfb7f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:08.555330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 643/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Aug 30 00:27:08 2022] GET /identity/v3/role_assignments?user.id=ab238ea3e0614e92a53cda1b0fc413f8&scope.project.id=20646077df5b45409498a71f7787f6e7&role.id=e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:10.454178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372dc4d-dc06-40a4-91ef-b8b0ab52e6eb None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:10.454971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372dc4d-dc06-40a4-91ef-b8b0ab52e6eb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:10.455113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372dc4d-dc06-40a4-91ef-b8b0ab52e6eb None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:10.457240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 645/1288] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:27:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:27:10.463416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1c75c-dd75-4f02-9c95-66727ac781d6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:10.463867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1c75c-dd75-4f02-9c95-66727ac781d6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:10.463965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1c75c-dd75-4f02-9c95-66727ac781d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:10.485297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ddf1c75c-dd75-4f02-9c95-66727ac781d6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:27:10.486668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ddf1c75c-dd75-4f02-9c95-66727ac781d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:10.522805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:10.567745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 644/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:27:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:27:10.843780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372dc4d-dc06-40a4-91ef-b8b0ab52e6eb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:10.959817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372dc4d-dc06-40a4-91ef-b8b0ab52e6eb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:10.970464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:10.995348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:10.995968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:10.996245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:10.996511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:10.997085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:10.998486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:11.007482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:11.008696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:11.009765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 646/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:27:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:11.014875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1c75c-dd75-4f02-9c95-66727ac781d6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:11.122467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1c75c-dd75-4f02-9c95-66727ac781d6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:11.161265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171948-71ba-4025-a500-5abed7ee0cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:11.161884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171948-71ba-4025-a500-5abed7ee0cfb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:11.162150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171948-71ba-4025-a500-5abed7ee0cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:11.162409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171948-71ba-4025-a500-5abed7ee0cfb None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:11.163021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171948-71ba-4025-a500-5abed7ee0cfb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:11.163314 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171948-71ba-4025-a500-5abed7ee0cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:11.164806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171948-71ba-4025-a500-5abed7ee0cfb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:11.169702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 645/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 30 00:27:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:11.175688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:11.290445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fc93-9dc1-48c9-a7f6-60e96246d81e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:11.328789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3d7db-c145-479c-bdc2-80b2fa6c207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:11.329382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3d7db-c145-479c-bdc2-80b2fa6c207c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:11.329665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3d7db-c145-479c-bdc2-80b2fa6c207c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:11.329933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3d7db-c145-479c-bdc2-80b2fa6c207c None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:11.330553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3d7db-c145-479c-bdc2-80b2fa6c207c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:11.330846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3d7db-c145-479c-bdc2-80b2fa6c207c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:11.332199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3d7db-c145-479c-bdc2-80b2fa6c207c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:11.336756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 647/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 30 00:27:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:13.204103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208124-e323-47a9-8858-22410ee65073 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:13.204670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208124-e323-47a9-8858-22410ee65073 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:13.204670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208124-e323-47a9-8858-22410ee65073 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:13.206029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 646/1293] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:27:13.212199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e0739-9842-4570-be9b-d3d4abc35222 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:13.212960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e0739-9842-4570-be9b-d3d4abc35222 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:13.213090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e0739-9842-4570-be9b-d3d4abc35222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:13.234787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-de7e0739-9842-4570-be9b-d3d4abc35222 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:27:13.235960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-de7e0739-9842-4570-be9b-d3d4abc35222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:13.278616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:13.320086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 648/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:27:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:27:13.585081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00208124-e323-47a9-8858-22410ee65073 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:13.622821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:13.709993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00208124-e323-47a9-8858-22410ee65073 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:13.744855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97067fb7-1843-4dd7-bff5-3bc62aeab863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:13.745439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067fb7-1843-4dd7-bff5-3bc62aeab863 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:13.745744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067fb7-1843-4dd7-bff5-3bc62aeab863 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:13.746007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067fb7-1843-4dd7-bff5-3bc62aeab863 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:13.746629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97067fb7-1843-4dd7-bff5-3bc62aeab863 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:13.747983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97067fb7-1843-4dd7-bff5-3bc62aeab863 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:13.764205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 647/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Aug 30 00:27:13 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:27:15.698022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678067de-b525-401d-a1a2-ac9c9d77e472 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:15.698923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678067de-b525-401d-a1a2-ac9c9d77e472 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:15.698923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678067de-b525-401d-a1a2-ac9c9d77e472 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:15.700996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 649/1296] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:27:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:27:15.708826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cea70-6b96-4a47-981a-fa6742717dce None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:15.709285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cea70-6b96-4a47-981a-fa6742717dce None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:15.709532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cea70-6b96-4a47-981a-fa6742717dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:15.728632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ef4cea70-6b96-4a47-981a-fa6742717dce None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:27:15.729813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ef4cea70-6b96-4a47-981a-fa6742717dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:15.805772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 648/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:27:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:27:16.089189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678067de-b525-401d-a1a2-ac9c9d77e472 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:16.202266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678067de-b525-401d-a1a2-ac9c9d77e472 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:16.238011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:16.238620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:16.238893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:16.239142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:16.239715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:16.241084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:16.249996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:16.251435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:16.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:16.253725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 650/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:27:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:16.258033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cea70-6b96-4a47-981a-fa6742717dce None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:16.285679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:16.382483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cea70-6b96-4a47-981a-fa6742717dce None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:16.425633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:16.426240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:16.426518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:16.426786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:16.427416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:16.427714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:16.429091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:16.434429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 649/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 30 00:27:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:16.441269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:16.474187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:16.545699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4131b37-22fe-4621-ac57-3b9e02279903 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:16.580608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27009926-8424-419a-9e73-a61e4177f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:16.581205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27009926-8424-419a-9e73-a61e4177f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:16.581486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27009926-8424-419a-9e73-a61e4177f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:16.581788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27009926-8424-419a-9e73-a61e4177f2a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:16.582489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27009926-8424-419a-9e73-a61e4177f2a6 None admin] RBAC: Adding query filter params (interface=public, service_id=abc9cc1483af4f50a2f90b02ee00dbff, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:16.582769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27009926-8424-419a-9e73-a61e4177f2a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:16.584169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27009926-8424-419a-9e73-a61e4177f2a6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:16.589293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 651/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Aug 30 00:27:16 2022] GET /identity/v3/endpoints?service_id=abc9cc1483af4f50a2f90b02ee00dbff&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:16.596138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:16.686076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:16.707496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d0be2-4cd5-4ef2-954b-6de9ec628171 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:16.744149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530f281-1dcb-4838-b77f-f95374013312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:16.744748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f281-1dcb-4838-b77f-f95374013312 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:16.744995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f281-1dcb-4838-b77f-f95374013312 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:16.745263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f281-1dcb-4838-b77f-f95374013312 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:16.745887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530f281-1dcb-4838-b77f-f95374013312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:16.747243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530f281-1dcb-4838-b77f-f95374013312 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:16.754398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 650/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Aug 30 00:27:16 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:27:18.621601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc01a-2884-4712-8dff-ca73a09fc592 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:18.622531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc01a-2884-4712-8dff-ca73a09fc592 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:18.622531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc01a-2884-4712-8dff-ca73a09fc592 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:18.624717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 652/1302] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:27:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:27:18.631146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb943-1296-45b6-b2b8-7892b7ff3d75 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:18.632056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb943-1296-45b6-b2b8-7892b7ff3d75 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:18.632852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfb943-1296-45b6-b2b8-7892b7ff3d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:18.660547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3ecfb943-1296-45b6-b2b8-7892b7ff3d75 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:27:18.661709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3ecfb943-1296-45b6-b2b8-7892b7ff3d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:18.740442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 651/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:27:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:27:19.007843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc01a-2884-4712-8dff-ca73a09fc592 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:19.115237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:19.126324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc01a-2884-4712-8dff-ca73a09fc592 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:19.162053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:19.162674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:19.162980 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:19.163249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:19.163827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:19.165195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:27:19.174168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:27:19.175318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Aug 30 00:27:19.176533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 653/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Aug 30 00:27:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:27:19.182199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfb943-1296-45b6-b2b8-7892b7ff3d75 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:19.269887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:19.297902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfb943-1296-45b6-b2b8-7892b7ff3d75 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:19.334891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51afda7-b293-4ec7-bbba-49651f3a4012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:19.335520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51afda7-b293-4ec7-bbba-49651f3a4012 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:19.335790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51afda7-b293-4ec7-bbba-49651f3a4012 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:19.336057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51afda7-b293-4ec7-bbba-49651f3a4012 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:19.336704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51afda7-b293-4ec7-bbba-49651f3a4012 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:27:19.337011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51afda7-b293-4ec7-bbba-49651f3a4012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:19.338430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51afda7-b293-4ec7-bbba-49651f3a4012 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:19.347228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 652/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Aug 30 00:27:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:27:19.356445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:19.491095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbd294-a76a-4129-984b-693b5ec027c5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:19.527183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53426b-d034-4f16-b6bd-e4a283ecf63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:19.527703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53426b-d034-4f16-b6bd-e4a283ecf63b None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:19.527975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53426b-d034-4f16-b6bd-e4a283ecf63b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:19.528240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53426b-d034-4f16-b6bd-e4a283ecf63b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:19.528900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53426b-d034-4f16-b6bd-e4a283ecf63b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:19.530556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53426b-d034-4f16-b6bd-e4a283ecf63b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:19.562163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 654/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:27:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:27:29.340550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=30 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:29.556992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:23.103594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb49eab-8375-4600-a4a4-1b6ea4b59332 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:23.104680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb49eab-8375-4600-a4a4-1b6ea4b59332 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:23.105186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb49eab-8375-4600-a4a4-1b6ea4b59332 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:23.111007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 653/1307] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:23.112370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9de87-c9bd-4d0c-957e-2fb5146ded2c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:23.112813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9de87-c9bd-4d0c-957e-2fb5146ded2c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:23.112902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9de87-c9bd-4d0c-957e-2fb5146ded2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:23.187081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-40d9de87-c9bd-4d0c-957e-2fb5146ded2c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:23.188298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-40d9de87-c9bd-4d0c-957e-2fb5146ded2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:23.313569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 655/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:28:23.631211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbf42e-231d-45cd-928a-cb1365327378 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:23.631754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbf42e-231d-45cd-928a-cb1365327378 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:23.632230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbf42e-231d-45cd-928a-cb1365327378 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:23.634052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 654/1309] 10.222.0.42 () {54 vars in 965 bytes} [Tue Aug 30 00:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:23.639933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9eb4e-698e-4485-baa1-db1723116568 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:23.640527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9eb4e-698e-4485-baa1-db1723116568 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:23.640946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9eb4e-698e-4485-baa1-db1723116568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:23.718601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-43c9eb4e-698e-4485-baa1-db1723116568 None None] MFA Rules not processed for user `77470d4430f04d30b64297de78e67f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:23.720090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43c9eb4e-698e-4485-baa1-db1723116568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:23.742266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:23.799507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 656/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Aug 30 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:23.808950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbf42e-231d-45cd-928a-cb1365327378 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:23.810989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-83fbf42e-231d-45cd-928a-cb1365327378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:23.930096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbf42e-231d-45cd-928a-cb1365327378 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:24.007279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd2004-be5e-4d97-b098-71e3fe53aa0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:24.008234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd2004-be5e-4d97-b098-71e3fe53aa0e service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:24.008657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd2004-be5e-4d97-b098-71e3fe53aa0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:24.009094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd2004-be5e-4d97-b098-71e3fe53aa0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:24.010996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bbfd2004-be5e-4d97-b098-71e3fe53aa0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:24.075728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:24.143813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd2004-be5e-4d97-b098-71e3fe53aa0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:24.145281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd2004-be5e-4d97-b098-71e3fe53aa0e service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:24.168299 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 655/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:26.336947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3ebdf-340b-4a2c-a302-ef5f78df6168 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:26.337519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3ebdf-340b-4a2c-a302-ef5f78df6168 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:26.337519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3ebdf-340b-4a2c-a302-ef5f78df6168 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:26.339150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 657/1312] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:26.344705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98e682-015d-4538-9566-1f15035baa02 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:26.345276 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98e682-015d-4538-9566-1f15035baa02 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:26.345276 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98e682-015d-4538-9566-1f15035baa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:26.441347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bb98e682-015d-4538-9566-1f15035baa02 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:26.443272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bb98e682-015d-4538-9566-1f15035baa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:26.552593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 656/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:26.835763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3ebdf-340b-4a2c-a302-ef5f78df6168 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:26.837360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2fe3ebdf-340b-4a2c-a302-ef5f78df6168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:26.946648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3ebdf-340b-4a2c-a302-ef5f78df6168 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:27.023086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:27.026023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12326cc8-e565-4327-a643-a5df3b258db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:27.026950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326cc8-e565-4327-a643-a5df3b258db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:27.027503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326cc8-e565-4327-a643-a5df3b258db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:27.027801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12326cc8-e565-4327-a643-a5df3b258db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:27.029697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-12326cc8-e565-4327-a643-a5df3b258db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:27.143359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12326cc8-e565-4327-a643-a5df3b258db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:27.144788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12326cc8-e565-4327-a643-a5df3b258db1 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:27.163187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 658/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:29.384357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672aeb5-b84d-4831-a598-6326c8c8e43a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:29.384908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672aeb5-b84d-4831-a598-6326c8c8e43a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:29.384908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672aeb5-b84d-4831-a598-6326c8c8e43a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:29.388799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 657/1315] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:28:29.391752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc799e6-f4b4-47d8-b5f3-d61ff070e049 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:29.392148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc799e6-f4b4-47d8-b5f3-d61ff070e049 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:29.392295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc799e6-f4b4-47d8-b5f3-d61ff070e049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:29.459799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7cc799e6-f4b4-47d8-b5f3-d61ff070e049 None None] MFA Rules not processed for user `09756cf486814b05b937a688887b6c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:29.461111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7cc799e6-f4b4-47d8-b5f3-d61ff070e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:29.514932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:29.560165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 659/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:29.846280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672aeb5-b84d-4831-a598-6326c8c8e43a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:29.847812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7672aeb5-b84d-4831-a598-6326c8c8e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:29.858540 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:29.977497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672aeb5-b84d-4831-a598-6326c8c8e43a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:30.054379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34e8ef-2444-4e23-aa72-3c73a689b2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:30.054976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34e8ef-2444-4e23-aa72-3c73a689b2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:30.055264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34e8ef-2444-4e23-aa72-3c73a689b2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:30.055523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34e8ef-2444-4e23-aa72-3c73a689b2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:30.057118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8d34e8ef-2444-4e23-aa72-3c73a689b2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:30.122022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:30.173430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34e8ef-2444-4e23-aa72-3c73a689b2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:30.175160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34e8ef-2444-4e23-aa72-3c73a689b2d5 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:30.194283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 658/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:28:32.638909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5371f6-2c07-4ad7-ae24-8b9ebe25a000 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:32.639762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5371f6-2c07-4ad7-ae24-8b9ebe25a000 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:32.639762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5371f6-2c07-4ad7-ae24-8b9ebe25a000 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:32.642129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 660/1318] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:32.648504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d68ea-730c-4c1e-b857-8b0aab35fe89 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:32.649246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d68ea-730c-4c1e-b857-8b0aab35fe89 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:32.649395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d68ea-730c-4c1e-b857-8b0aab35fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:32.720249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c03d68ea-730c-4c1e-b857-8b0aab35fe89 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:32.721473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c03d68ea-730c-4c1e-b857-8b0aab35fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:32.827653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 659/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:33.109922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5371f6-2c07-4ad7-ae24-8b9ebe25a000 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:33.112320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc5371f6-2c07-4ad7-ae24-8b9ebe25a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:33.228628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5371f6-2c07-4ad7-ae24-8b9ebe25a000 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:33.316011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe257ca-28b5-43c1-9443-b513a413517d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:33.316607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe257ca-28b5-43c1-9443-b513a413517d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:33.316882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe257ca-28b5-43c1-9443-b513a413517d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:33.317145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe257ca-28b5-43c1-9443-b513a413517d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:33.318751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6fe257ca-28b5-43c1-9443-b513a413517d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:33.326213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:33.434514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe257ca-28b5-43c1-9443-b513a413517d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:33.436013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe257ca-28b5-43c1-9443-b513a413517d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:33.455051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 661/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:36.037217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f35d2-9619-4c6d-89e7-1c5a444f42f8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:36.037801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f35d2-9619-4c6d-89e7-1c5a444f42f8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:36.037801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f35d2-9619-4c6d-89e7-1c5a444f42f8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:36.039325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 660/1321] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:36.044540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c3a44-c706-485d-9e0f-6ad902b09e8e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:36.045031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c3a44-c706-485d-9e0f-6ad902b09e8e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:36.045131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c3a44-c706-485d-9e0f-6ad902b09e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:36.113188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a93c3a44-c706-485d-9e0f-6ad902b09e8e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:36.114433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a93c3a44-c706-485d-9e0f-6ad902b09e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:36.174689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:36.213478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 662/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:28:36.505007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b94-0381-42e7-9b0b-e79abb9812dd None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:36.505273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b94-0381-42e7-9b0b-e79abb9812dd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:36.505537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83117b94-0381-42e7-9b0b-e79abb9812dd None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:36.506912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 661/1323] 10.222.0.42 () {54 vars in 965 bytes} [Tue Aug 30 00:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:36.513203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea618-dc65-4e41-85e6-8c35679d1907 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:36.513836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea618-dc65-4e41-85e6-8c35679d1907 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:36.514109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ea618-dc65-4e41-85e6-8c35679d1907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:36.593154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-192ea618-dc65-4e41-85e6-8c35679d1907 None None] MFA Rules not processed for user `77470d4430f04d30b64297de78e67f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:36.594405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-192ea618-dc65-4e41-85e6-8c35679d1907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:36.674037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 663/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Aug 30 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:36.683161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117b94-0381-42e7-9b0b-e79abb9812dd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:36.684681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-83117b94-0381-42e7-9b0b-e79abb9812dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:36.704237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:36.793387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83117b94-0381-42e7-9b0b-e79abb9812dd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:36.879408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad929192-aa32-4f66-9f69-9edd9f88c423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:36.880024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad929192-aa32-4f66-9f69-9edd9f88c423 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:36.880298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad929192-aa32-4f66-9f69-9edd9f88c423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:36.880566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad929192-aa32-4f66-9f69-9edd9f88c423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:36.882277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ad929192-aa32-4f66-9f69-9edd9f88c423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:36.954082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:36.993721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad929192-aa32-4f66-9f69-9edd9f88c423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:36.995119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad929192-aa32-4f66-9f69-9edd9f88c423 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:37.014080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 662/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:39.250885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e4bf5-2343-4694-9d15-b330ee6edf82 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:39.251483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e4bf5-2343-4694-9d15-b330ee6edf82 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:39.251483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e4bf5-2343-4694-9d15-b330ee6edf82 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:39.252763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 664/1326] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:39.258185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99fcb1-a81f-4556-b549-1f62fafe1553 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:39.258635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99fcb1-a81f-4556-b549-1f62fafe1553 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:39.258739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99fcb1-a81f-4556-b549-1f62fafe1553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:39.327632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5a99fcb1-a81f-4556-b549-1f62fafe1553 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:39.328860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5a99fcb1-a81f-4556-b549-1f62fafe1553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:39.434187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 663/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:39.710685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e4bf5-2343-4694-9d15-b330ee6edf82 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:39.712349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fc3e4bf5-2343-4694-9d15-b330ee6edf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:39.778044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:39.825774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e4bf5-2343-4694-9d15-b330ee6edf82 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:39.904262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe47ed-9006-4260-8c7c-59b0b9227284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:39.904877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe47ed-9006-4260-8c7c-59b0b9227284 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:39.905154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe47ed-9006-4260-8c7c-59b0b9227284 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:39.905418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe47ed-9006-4260-8c7c-59b0b9227284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:39.907033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-09fe47ed-9006-4260-8c7c-59b0b9227284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:40.019353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:40.022101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe47ed-9006-4260-8c7c-59b0b9227284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:40.024330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe47ed-9006-4260-8c7c-59b0b9227284 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:40.043623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 665/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:42.006712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991f20-46e1-4e05-8c33-570f8b6be943 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:42.007279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991f20-46e1-4e05-8c33-570f8b6be943 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:42.007279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991f20-46e1-4e05-8c33-570f8b6be943 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:42.008616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 664/1329] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:42.014282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad418e-0a7b-4af3-a351-ab1c21b291e5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:42.014733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad418e-0a7b-4af3-a351-ab1c21b291e5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:42.014838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad418e-0a7b-4af3-a351-ab1c21b291e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:42.081448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f0ad418e-0a7b-4af3-a351-ab1c21b291e5 None None] MFA Rules not processed for user `09756cf486814b05b937a688887b6c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:42.082698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f0ad418e-0a7b-4af3-a351-ab1c21b291e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:42.183492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 666/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:42.471945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991f20-46e1-4e05-8c33-570f8b6be943 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:42.473486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fe991f20-46e1-4e05-8c33-570f8b6be943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:42.507612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:42.593783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991f20-46e1-4e05-8c33-570f8b6be943 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:42.673934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34413092-2856-4b56-90e0-69f18cfd3daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:42.674559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413092-2856-4b56-90e0-69f18cfd3daf service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:42.674832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413092-2856-4b56-90e0-69f18cfd3daf service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:42.675096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34413092-2856-4b56-90e0-69f18cfd3daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:42.676719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-34413092-2856-4b56-90e0-69f18cfd3daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:42.758167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:42.800570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34413092-2856-4b56-90e0-69f18cfd3daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:42.802086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34413092-2856-4b56-90e0-69f18cfd3daf service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:42.827090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 665/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:44.941607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5abea-205d-46a0-bfd3-577aff7bf2d9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:44.942848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5abea-205d-46a0-bfd3-577aff7bf2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:44.942848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5abea-205d-46a0-bfd3-577aff7bf2d9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:44.943629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 667/1332] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:44.949649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8a7a-fa7a-4c3d-85cc-4680156cc4d8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:44.950114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8a7a-fa7a-4c3d-85cc-4680156cc4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:44.950214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed8a7a-fa7a-4c3d-85cc-4680156cc4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:45.024510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-35ed8a7a-fa7a-4c3d-85cc-4680156cc4d8 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:45.025640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-35ed8a7a-fa7a-4c3d-85cc-4680156cc4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:45.127993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 666/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:45.415771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5abea-205d-46a0-bfd3-577aff7bf2d9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:45.417335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-59a5abea-205d-46a0-bfd3-577aff7bf2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:45.500115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:45.537277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5abea-205d-46a0-bfd3-577aff7bf2d9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:45.625922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b916b3-5ec2-445c-9967-7e0fac441df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:45.626541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b916b3-5ec2-445c-9967-7e0fac441df5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:45.626817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b916b3-5ec2-445c-9967-7e0fac441df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:45.627084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b916b3-5ec2-445c-9967-7e0fac441df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:45.628672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4b916b3-5ec2-445c-9967-7e0fac441df5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:45.750355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b916b3-5ec2-445c-9967-7e0fac441df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:45.751797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b916b3-5ec2-445c-9967-7e0fac441df5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:45.762355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:45.772396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 668/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:47.729819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b2557-07ea-4b6e-ab55-971ed01b80c0 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:47.730411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b2557-07ea-4b6e-ab55-971ed01b80c0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:47.730411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b2557-07ea-4b6e-ab55-971ed01b80c0 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:47.731718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 667/1335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:47.738304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bca9f-7194-43dd-b01e-a7cacd417efc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:47.739092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bca9f-7194-43dd-b01e-a7cacd417efc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:47.739260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bca9f-7194-43dd-b01e-a7cacd417efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:47.812616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ff0bca9f-7194-43dd-b01e-a7cacd417efc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:47.813862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ff0bca9f-7194-43dd-b01e-a7cacd417efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:47.918453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 669/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:48.207128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b2557-07ea-4b6e-ab55-971ed01b80c0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:48.209687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6e3b2557-07ea-4b6e-ab55-971ed01b80c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:48.261941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:48.328844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b2557-07ea-4b6e-ab55-971ed01b80c0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:48.411822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e823e-1a2c-42a5-a802-ba1b9534714c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:48.412428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e823e-1a2c-42a5-a802-ba1b9534714c service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:48.412701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e823e-1a2c-42a5-a802-ba1b9534714c service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:48.412965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e823e-1a2c-42a5-a802-ba1b9534714c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:48.414605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-262e823e-1a2c-42a5-a802-ba1b9534714c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:48.510625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:48.540494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e823e-1a2c-42a5-a802-ba1b9534714c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:48.541959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e823e-1a2c-42a5-a802-ba1b9534714c service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:48.562634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 668/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:50.773808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b067f-73f4-4bd8-be20-255e4fb8ae6a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:50.774308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b067f-73f4-4bd8-be20-255e4fb8ae6a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:50.774404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b067f-73f4-4bd8-be20-255e4fb8ae6a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:50.776481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 670/1338] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:50.783447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d9568-d771-43ce-9e5b-d12f5b7a5d25 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:50.783876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d9568-d771-43ce-9e5b-d12f5b7a5d25 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:50.783982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d9568-d771-43ce-9e5b-d12f5b7a5d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:50.855403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-243d9568-d771-43ce-9e5b-d12f5b7a5d25 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:50.856620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-243d9568-d771-43ce-9e5b-d12f5b7a5d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:50.970723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 669/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:51.250913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b067f-73f4-4bd8-be20-255e4fb8ae6a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:51.253425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9c9b067f-73f4-4bd8-be20-255e4fb8ae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:51.341201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:51.371778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b067f-73f4-4bd8-be20-255e4fb8ae6a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:51.453730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12615038-8ca3-4468-99cc-e42dd8f3a28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:51.454342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615038-8ca3-4468-99cc-e42dd8f3a28e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:51.454621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615038-8ca3-4468-99cc-e42dd8f3a28e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:51.454892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12615038-8ca3-4468-99cc-e42dd8f3a28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:51.456487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-12615038-8ca3-4468-99cc-e42dd8f3a28e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:51.583709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12615038-8ca3-4468-99cc-e42dd8f3a28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:51.585081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12615038-8ca3-4468-99cc-e42dd8f3a28e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:51.606425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 671/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:55.444078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b5ce7-ce85-4697-91ca-de31d565eb84 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:55.444631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b5ce7-ce85-4697-91ca-de31d565eb84 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:55.444631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b5ce7-ce85-4697-91ca-de31d565eb84 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:55.446630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 670/1341] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:55.451323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159a1c-a372-4bcb-8ce2-0d49fe81b98f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:55.451839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159a1c-a372-4bcb-8ce2-0d49fe81b98f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:55.451963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b159a1c-a372-4bcb-8ce2-0d49fe81b98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:55.457604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:55.522188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3b159a1c-a372-4bcb-8ce2-0d49fe81b98f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:55.523400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3b159a1c-a372-4bcb-8ce2-0d49fe81b98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:55.625181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 672/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:28:55.910428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b5ce7-ce85-4697-91ca-de31d565eb84 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:55.911959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1c5b5ce7-ce85-4697-91ca-de31d565eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:55.961524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:56.023133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b5ce7-ce85-4697-91ca-de31d565eb84 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:56.098950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77d6c3-29b6-4ef3-aa83-cbcbe90dff25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:56.099582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d6c3-29b6-4ef3-aa83-cbcbe90dff25 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:56.099858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d6c3-29b6-4ef3-aa83-cbcbe90dff25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:56.100129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d6c3-29b6-4ef3-aa83-cbcbe90dff25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:56.101786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc77d6c3-29b6-4ef3-aa83-cbcbe90dff25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:56.196622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:56.213634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77d6c3-29b6-4ef3-aa83-cbcbe90dff25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:56.215107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77d6c3-29b6-4ef3-aa83-cbcbe90dff25 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:56.233716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 671/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:58.774936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb75c-a059-4813-b3f9-880e28965f41 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:58.775422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb75c-a059-4813-b3f9-880e28965f41 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:58.775512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb75c-a059-4813-b3f9-880e28965f41 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:58.777069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 673/1344] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:28:58.783611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf249-9987-4c84-8e44-8d63ac7c1abc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:58.784170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf249-9987-4c84-8e44-8d63ac7c1abc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:58.784170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcf249-9987-4c84-8e44-8d63ac7c1abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:58.854465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2cfcf249-9987-4c84-8e44-8d63ac7c1abc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:28:58.855687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2cfcf249-9987-4c84-8e44-8d63ac7c1abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:58.953867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 672/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:28:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:28:59.231830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb75c-a059-4813-b3f9-880e28965f41 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:59.233415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-74dfb75c-a059-4813-b3f9-880e28965f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:59.319589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:59.337794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb75c-a059-4813-b3f9-880e28965f41 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:59.420243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ba30-68df-49ec-b5bf-27eea13bab09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:59.420873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ba30-68df-49ec-b5bf-27eea13bab09 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:59.421148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ba30-68df-49ec-b5bf-27eea13bab09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:59.421414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ba30-68df-49ec-b5bf-27eea13bab09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:59.423140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-25c6ba30-68df-49ec-b5bf-27eea13bab09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:59.538667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ba30-68df-49ec-b5bf-27eea13bab09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:59.540027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ba30-68df-49ec-b5bf-27eea13bab09 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:59.558286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 674/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:03.989746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc907c-d40c-4961-92e9-09919a95d4b0 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:03.990299 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc907c-d40c-4961-92e9-09919a95d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:03.990299 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc907c-d40c-4961-92e9-09919a95d4b0 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:03.991639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 673/1347] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:03.997140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc03e3-41b5-48dd-b6f7-d6743c21a4ea None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:03.997635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc03e3-41b5-48dd-b6f7-d6743c21a4ea None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:03.997755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc03e3-41b5-48dd-b6f7-d6743c21a4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:04.014940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:04.070930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d4fc03e3-41b5-48dd-b6f7-d6743c21a4ea None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:04.072145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4fc03e3-41b5-48dd-b6f7-d6743c21a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:04.178488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 675/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:04.459792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc907c-d40c-4961-92e9-09919a95d4b0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:04.462223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2ddc907c-d40c-4961-92e9-09919a95d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:04.531997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:04.579524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc907c-d40c-4961-92e9-09919a95d4b0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:04.651377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b7f41-c5e5-41e6-ae4f-17a891e130bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:04.651976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7f41-c5e5-41e6-ae4f-17a891e130bd service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:04.652248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7f41-c5e5-41e6-ae4f-17a891e130bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:04.652513 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7f41-c5e5-41e6-ae4f-17a891e130bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:04.654131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c09b7f41-c5e5-41e6-ae4f-17a891e130bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:04.781260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:04.786182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b7f41-c5e5-41e6-ae4f-17a891e130bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:04.787616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b7f41-c5e5-41e6-ae4f-17a891e130bd service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:04.810935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 674/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:09.690780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad96fd-ee91-4915-b500-2a1eccc366d7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:09.691274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad96fd-ee91-4915-b500-2a1eccc366d7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:09.691369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad96fd-ee91-4915-b500-2a1eccc366d7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:09.692952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 676/1350] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:09.698083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d274a7-00d9-497f-85d4-d1404039ee0e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:09.698559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d274a7-00d9-497f-85d4-d1404039ee0e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:09.698673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d274a7-00d9-497f-85d4-d1404039ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:09.831099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e6d274a7-00d9-497f-85d4-d1404039ee0e None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:09.832862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e6d274a7-00d9-497f-85d4-d1404039ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:09.965413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 675/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:29:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:13.957576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929f8f1-6256-412a-877d-af26c8d7ffdc None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:13.958131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929f8f1-6256-412a-877d-af26c8d7ffdc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:13.958131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929f8f1-6256-412a-877d-af26c8d7ffdc None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:13.959766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 677/1352] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:13.964756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a6c4c-389c-4584-8374-96dca581828b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:13.965604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a6c4c-389c-4584-8374-96dca581828b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:13.966088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a6c4c-389c-4584-8374-96dca581828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:14.025738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:14.051857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5a9a6c4c-389c-4584-8374-96dca581828b None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:14.053200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5a9a6c4c-389c-4584-8374-96dca581828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:14.170327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 676/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:29:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:14.177093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=59 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:15.663179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6fec3-f019-4209-976a-3b1932c6a242 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:15.663792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6fec3-f019-4209-976a-3b1932c6a242 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:15.663792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6fec3-f019-4209-976a-3b1932c6a242 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:15.664980 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 678/1354] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:15.670669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1579-c692-4782-ba00-0dcdf8dba04a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:15.671125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1579-c692-4782-ba00-0dcdf8dba04a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:15.671208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c1579-c692-4782-ba00-0dcdf8dba04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:15.752612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f48c1579-c692-4782-ba00-0dcdf8dba04a None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:15.753927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f48c1579-c692-4782-ba00-0dcdf8dba04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:15.797807 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:15.875229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 677/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:29:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:19.057445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b77cb-6faf-4a35-9a4c-8d6efd966342 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:19.058029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b77cb-6faf-4a35-9a4c-8d6efd966342 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:19.058029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b77cb-6faf-4a35-9a4c-8d6efd966342 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:19.059264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 679/1356] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:19.064684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177cf2-f10c-43af-9b2b-a32bfb29b62d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:19.065144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177cf2-f10c-43af-9b2b-a32bfb29b62d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:19.065248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177cf2-f10c-43af-9b2b-a32bfb29b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:19.142328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-68177cf2-f10c-43af-9b2b-a32bfb29b62d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:19.143520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-68177cf2-f10c-43af-9b2b-a32bfb29b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:19.265558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 678/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:19.564070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ed487-7d59-491c-b691-0196d209bb5b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:19.564696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ed487-7d59-491c-b691-0196d209bb5b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:19.564976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ed487-7d59-491c-b691-0196d209bb5b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:19.566572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 680/1358] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 30 00:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:19.575144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60ee2-7d4c-4cdc-ac66-997cbb4e7f04 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:19.575424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60ee2-7d4c-4cdc-ac66-997cbb4e7f04 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:19.575717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60ee2-7d4c-4cdc-ac66-997cbb4e7f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:19.599642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:19.664631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-85e60ee2-7d4c-4cdc-ac66-997cbb4e7f04 None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:19.666239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-85e60ee2-7d4c-4cdc-ac66-997cbb4e7f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:19.797602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 679/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 30 00:29:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:29:19.802185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ed487-7d59-491c-b691-0196d209bb5b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:19.803843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c79ed487-7d59-491c-b691-0196d209bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:19.960985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ed487-7d59-491c-b691-0196d209bb5b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:20.035592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:20.078336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a406-a427-415a-b391-dfa4b5714cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:20.079038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a406-a427-415a-b391-dfa4b5714cca service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:20.079270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a406-a427-415a-b391-dfa4b5714cca service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:20.079462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a406-a427-415a-b391-dfa4b5714cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:20.081044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cf51a406-a427-415a-b391-dfa4b5714cca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:20.184680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51a406-a427-415a-b391-dfa4b5714cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:20.186955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51a406-a427-415a-b391-dfa4b5714cca service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:20.208466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 681/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:22.322317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c546b9-b9f8-4556-9a7a-bfeb9835e293 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:22.322916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c546b9-b9f8-4556-9a7a-bfeb9835e293 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:22.322916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c546b9-b9f8-4556-9a7a-bfeb9835e293 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:22.324490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 680/1361] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:22.330199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebb3b-4b3d-4a85-a0dc-9507676fd77a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:22.330756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebb3b-4b3d-4a85-a0dc-9507676fd77a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:22.330756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ebb3b-4b3d-4a85-a0dc-9507676fd77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:22.399835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-165ebb3b-4b3d-4a85-a0dc-9507676fd77a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:22.401038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-165ebb3b-4b3d-4a85-a0dc-9507676fd77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:22.442482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:22.508580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 682/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:22.796681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c546b9-b9f8-4556-9a7a-bfeb9835e293 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:22.796681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b4c546b9-b9f8-4556-9a7a-bfeb9835e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:22.869108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:22.969209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c546b9-b9f8-4556-9a7a-bfeb9835e293 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:23.094642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84f56b-903c-45de-86f6-d44a29458d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:23.095404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84f56b-903c-45de-86f6-d44a29458d8d service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:23.095821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84f56b-903c-45de-86f6-d44a29458d8d service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:23.096367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84f56b-903c-45de-86f6-d44a29458d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:23.098159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3c84f56b-903c-45de-86f6-d44a29458d8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:23.126465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:23.210916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84f56b-903c-45de-86f6-d44a29458d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:23.212708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84f56b-903c-45de-86f6-d44a29458d8d service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:23.232686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 681/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:25.470771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71622a6f-861f-40b6-b43f-4fb17258c0f6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:25.471674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71622a6f-861f-40b6-b43f-4fb17258c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:25.472102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71622a6f-861f-40b6-b43f-4fb17258c0f6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:25.473468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 683/1364] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:25.479029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992b6d-a4fb-4cb3-a4c9-cc8f879a4375 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:25.479461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992b6d-a4fb-4cb3-a4c9-cc8f879a4375 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:25.479798 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef992b6d-a4fb-4cb3-a4c9-cc8f879a4375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:25.559495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ef992b6d-a4fb-4cb3-a4c9-cc8f879a4375 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:25.561254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ef992b6d-a4fb-4cb3-a4c9-cc8f879a4375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:25.665476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:25.673614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 682/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:25.954585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d4a2f-bf5d-4371-862f-b537a0acfe0a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:25.954870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d4a2f-bf5d-4371-862f-b537a0acfe0a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:25.955142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d4a2f-bf5d-4371-862f-b537a0acfe0a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:25.956643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 684/1366] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 30 00:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:25.962010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba925-67dc-4a3f-a17d-6ed73a0268f6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:25.962457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba925-67dc-4a3f-a17d-6ed73a0268f6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:25.962723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cba925-67dc-4a3f-a17d-6ed73a0268f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:26.045585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-51cba925-67dc-4a3f-a17d-6ed73a0268f6 None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:26.046901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-51cba925-67dc-4a3f-a17d-6ed73a0268f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:26.175754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 683/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 30 00:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:26.183934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d4a2f-bf5d-4371-862f-b537a0acfe0a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:26.185650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e49d4a2f-bf5d-4371-862f-b537a0acfe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:26.343078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d4a2f-bf5d-4371-862f-b537a0acfe0a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:26.366975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:26.483123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c090379-a68c-46b2-bf18-668e6a101459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:26.483794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c090379-a68c-46b2-bf18-668e6a101459 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:26.484056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c090379-a68c-46b2-bf18-668e6a101459 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:26.484244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c090379-a68c-46b2-bf18-668e6a101459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:26.485864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6c090379-a68c-46b2-bf18-668e6a101459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:26.586217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c090379-a68c-46b2-bf18-668e6a101459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:26.588044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c090379-a68c-46b2-bf18-668e6a101459 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:26.608517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 685/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:27.187244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84931690-3a28-4a4d-93a1-c7bcc7896c36 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:27.187878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84931690-3a28-4a4d-93a1-c7bcc7896c36 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:27.187878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84931690-3a28-4a4d-93a1-c7bcc7896c36 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:27.189434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 684/1369] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:27.194767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ab27-52fb-450c-ac6a-f564d8104167 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:27.195031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ab27-52fb-450c-ac6a-f564d8104167 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:27.195292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ab27-52fb-450c-ac6a-f564d8104167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:27.231357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:27.273708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4534ab27-52fb-450c-ac6a-f564d8104167 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:27.275073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4534ab27-52fb-450c-ac6a-f564d8104167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:27.375082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 686/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:27.954238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825ad1-49e8-4296-ba15-b9fa83cf0eeb None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:27.954520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825ad1-49e8-4296-ba15-b9fa83cf0eeb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:27.954792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825ad1-49e8-4296-ba15-b9fa83cf0eeb None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:27.956632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 685/1371] 10.222.0.42 () {54 vars in 964 bytes} [Tue Aug 30 00:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:27.961360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe85aa6-595b-4068-856f-e185c42df5ff None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:27.961922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe85aa6-595b-4068-856f-e185c42df5ff None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:27.961922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe85aa6-595b-4068-856f-e185c42df5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:28.041001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cfe85aa6-595b-4068-856f-e185c42df5ff None None] MFA Rules not processed for user `5301330fc789466ab0c1c4aae41b6330`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:28.043459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfe85aa6-595b-4068-856f-e185c42df5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:28.090977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:28.122137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 687/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Aug 30 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:28.130754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825ad1-49e8-4296-ba15-b9fa83cf0eeb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:28.132268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-79825ad1-49e8-4296-ba15-b9fa83cf0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:28.188642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:28.248772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825ad1-49e8-4296-ba15-b9fa83cf0eeb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:28.336611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850af9ef-688e-4346-b151-70d810ff6c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:28.337228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af9ef-688e-4346-b151-70d810ff6c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:28.337577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af9ef-688e-4346-b151-70d810ff6c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:28.337857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850af9ef-688e-4346-b151-70d810ff6c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:28.339622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-850af9ef-688e-4346-b151-70d810ff6c31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:28.496041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:28.521264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af9ef-688e-4346-b151-70d810ff6c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:28.523077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850af9ef-688e-4346-b151-70d810ff6c31 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:28.545835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 686/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:28.586974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341c32f-6077-4482-a632-3c4ea6d003b6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:28.587334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341c32f-6077-4482-a632-3c4ea6d003b6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:28.587518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341c32f-6077-4482-a632-3c4ea6d003b6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:28.589154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 688/1374] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:28.594582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43a61-b307-4236-a3e2-4715490f93e4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:28.594888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43a61-b307-4236-a3e2-4715490f93e4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:28.595042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de43a61-b307-4236-a3e2-4715490f93e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:28.662752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3de43a61-b307-4236-a3e2-4715490f93e4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:28.663979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3de43a61-b307-4236-a3e2-4715490f93e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:28.766471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 687/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:29.051966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341c32f-6077-4482-a632-3c4ea6d003b6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:29.053604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4341c32f-6077-4482-a632-3c4ea6d003b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:29.211812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341c32f-6077-4482-a632-3c4ea6d003b6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:29.272428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:29.335414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa0536-0ec1-4dae-aaac-6d2f3d1afc31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:29.335971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0536-0ec1-4dae-aaac-6d2f3d1afc31 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:29.336248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0536-0ec1-4dae-aaac-6d2f3d1afc31 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:29.336510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0536-0ec1-4dae-aaac-6d2f3d1afc31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:29.338251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3caa0536-0ec1-4dae-aaac-6d2f3d1afc31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:29.429736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa0536-0ec1-4dae-aaac-6d2f3d1afc31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:29.431553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa0536-0ec1-4dae-aaac-6d2f3d1afc31 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:29.450411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 689/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:31.391934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1435acb-f910-4bfe-a7ee-282ce5fb14ea None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:31.391934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1435acb-f910-4bfe-a7ee-282ce5fb14ea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:31.391934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1435acb-f910-4bfe-a7ee-282ce5fb14ea None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:31.393211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 688/1377] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:31.398662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f877-c097-4742-b67e-e048d3d7387f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:31.399061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f877-c097-4742-b67e-e048d3d7387f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:31.399192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f877-c097-4742-b67e-e048d3d7387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:31.476859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f198f877-c097-4742-b67e-e048d3d7387f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:31.478115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f198f877-c097-4742-b67e-e048d3d7387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:31.486554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:31.598192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 690/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:31.885112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1435acb-f910-4bfe-a7ee-282ce5fb14ea None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:31.887058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a1435acb-f910-4bfe-a7ee-282ce5fb14ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:31.976014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:32.083891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1435acb-f910-4bfe-a7ee-282ce5fb14ea None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:32.212134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03fcc4-be82-4acf-881f-ca0b4ca2ac0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:32.212886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fcc4-be82-4acf-881f-ca0b4ca2ac0d service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:32.213238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fcc4-be82-4acf-881f-ca0b4ca2ac0d service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:32.213606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fcc4-be82-4acf-881f-ca0b4ca2ac0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:32.215309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7a03fcc4-be82-4acf-881f-ca0b4ca2ac0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:32.237952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:32.318290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03fcc4-be82-4acf-881f-ca0b4ca2ac0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:32.320012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03fcc4-be82-4acf-881f-ca0b4ca2ac0d service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:32.339626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 689/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:34.276642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9429-2866-4e04-8488-f7866511b44d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:34.277158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9429-2866-4e04-8488-f7866511b44d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:34.277255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9429-2866-4e04-8488-f7866511b44d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:34.278764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 691/1380] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:34.284073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4a238-6d60-4e67-9295-aa7da86d252e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:34.284858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4a238-6d60-4e67-9295-aa7da86d252e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:34.285094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4a238-6d60-4e67-9295-aa7da86d252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:34.353677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e6c4a238-6d60-4e67-9295-aa7da86d252e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:34.354911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e6c4a238-6d60-4e67-9295-aa7da86d252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:34.456566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:34.467408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 690/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:34.747460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9429-2866-4e04-8488-f7866511b44d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:34.749579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dd7a9429-2866-4e04-8488-f7866511b44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:34.908717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:34.920537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9429-2866-4e04-8488-f7866511b44d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:35.042436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5daea-45a3-46c6-a8c4-2db4ffc303f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:35.043130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5daea-45a3-46c6-a8c4-2db4ffc303f0 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:35.043500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5daea-45a3-46c6-a8c4-2db4ffc303f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:35.043855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5daea-45a3-46c6-a8c4-2db4ffc303f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:35.045630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-57c5daea-45a3-46c6-a8c4-2db4ffc303f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:35.148413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5daea-45a3-46c6-a8c4-2db4ffc303f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:35.150220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5daea-45a3-46c6-a8c4-2db4ffc303f0 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:35.169362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 692/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:35.184430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:37.148373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffdcf8-71ec-4d38-8f50-6cd5f58a9531 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:37.148907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffdcf8-71ec-4d38-8f50-6cd5f58a9531 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:37.148907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffdcf8-71ec-4d38-8f50-6cd5f58a9531 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:37.150349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 691/1383] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:37.156688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e1fc-e71f-4b16-9d4f-f7a635ba3401 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:37.157106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e1fc-e71f-4b16-9d4f-f7a635ba3401 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:37.157234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e1fc-e71f-4b16-9d4f-f7a635ba3401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:37.225995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a081e1fc-e71f-4b16-9d4f-f7a635ba3401 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:37.227446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a081e1fc-e71f-4b16-9d4f-f7a635ba3401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:37.334575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 693/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:37.688553 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffdcf8-71ec-4d38-8f50-6cd5f58a9531 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:37.690191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7fffdcf8-71ec-4d38-8f50-6cd5f58a9531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:37.852339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffdcf8-71ec-4d38-8f50-6cd5f58a9531 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:37.922443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:37.971001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0805261-1a0a-4b1d-aa45-3788fd1584c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:37.971622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805261-1a0a-4b1d-aa45-3788fd1584c8 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:37.971910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805261-1a0a-4b1d-aa45-3788fd1584c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:37.972164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0805261-1a0a-4b1d-aa45-3788fd1584c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:37.973886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b0805261-1a0a-4b1d-aa45-3788fd1584c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:38.070235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0805261-1a0a-4b1d-aa45-3788fd1584c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:38.071844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0805261-1a0a-4b1d-aa45-3788fd1584c8 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:38.091135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 692/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:40.371342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6ef8-d1f9-4fa0-9421-5cfc5217ae29 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:40.371919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6ef8-d1f9-4fa0-9421-5cfc5217ae29 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:40.372012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6ef8-d1f9-4fa0-9421-5cfc5217ae29 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:40.374155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 694/1386] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:40.379503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d020559-84de-45ae-b8e9-410edbe54eea None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:40.380002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d020559-84de-45ae-b8e9-410edbe54eea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:40.380101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d020559-84de-45ae-b8e9-410edbe54eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:40.451939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5d020559-84de-45ae-b8e9-410edbe54eea None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:40.453151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5d020559-84de-45ae-b8e9-410edbe54eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:40.488193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:40.555589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 693/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:40.848798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d6ef8-d1f9-4fa0-9421-5cfc5217ae29 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:40.850825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-076d6ef8-d1f9-4fa0-9421-5cfc5217ae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:40.940184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:41.026709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d6ef8-d1f9-4fa0-9421-5cfc5217ae29 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:41.160490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8d3c9-c9f6-4d9d-accb-3788b0451cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:41.161032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8d3c9-c9f6-4d9d-accb-3788b0451cce service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:41.161310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8d3c9-c9f6-4d9d-accb-3788b0451cce service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:41.161612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8d3c9-c9f6-4d9d-accb-3788b0451cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:41.163275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f4c8d3c9-c9f6-4d9d-accb-3788b0451cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:41.204904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:41.266887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8d3c9-c9f6-4d9d-accb-3788b0451cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:41.268572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8d3c9-c9f6-4d9d-accb-3788b0451cce service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:41.286899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 695/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:43.262208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82271-dc3b-41bb-a289-2fb82d2ad6af None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:43.262819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82271-dc3b-41bb-a289-2fb82d2ad6af None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:43.262819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82271-dc3b-41bb-a289-2fb82d2ad6af None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:43.264162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 694/1389] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:43.269470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b8d9-fc61-4847-a918-7ecc3d6f31e0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:43.269942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b8d9-fc61-4847-a918-7ecc3d6f31e0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:43.270054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5b8d9-fc61-4847-a918-7ecc3d6f31e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:43.339672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-49d5b8d9-fc61-4847-a918-7ecc3d6f31e0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:43.340874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-49d5b8d9-fc61-4847-a918-7ecc3d6f31e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:43.446157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 696/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:43.729801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82271-dc3b-41bb-a289-2fb82d2ad6af None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:43.731345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9a82271-dc3b-41bb-a289-2fb82d2ad6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:43.798305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772c1a-d746-4b4b-a821-4e407a3d9816 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:43.798660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772c1a-d746-4b4b-a821-4e407a3d9816 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:43.798960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772c1a-d746-4b4b-a821-4e407a3d9816 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:43.800512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 697/1391] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:29:43.805732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b6524-df78-4e7b-aba1-a44f0096d1e6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:43.806007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b6524-df78-4e7b-aba1-a44f0096d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:43.806271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b6524-df78-4e7b-aba1-a44f0096d1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:43.822274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:43.873405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-478b6524-df78-4e7b-aba1-a44f0096d1e6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:43.874702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-478b6524-df78-4e7b-aba1-a44f0096d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:43.883975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82271-dc3b-41bb-a289-2fb82d2ad6af None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:43.901781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:43.971837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 698/1392] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:29:44.000288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8d70a-ed56-44f6-8a2d-857a62066dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:44.001003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d70a-ed56-44f6-8a2d-857a62066dd1 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:44.001284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d70a-ed56-44f6-8a2d-857a62066dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:44.001569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d70a-ed56-44f6-8a2d-857a62066dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:44.003236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-89b8d70a-ed56-44f6-8a2d-857a62066dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:44.093736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8d70a-ed56-44f6-8a2d-857a62066dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:44.095365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8d70a-ed56-44f6-8a2d-857a62066dd1 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:44.113235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 695/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:44.268394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44cd0-6806-49fd-a0a7-52e9c68cc521 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:44.268677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44cd0-6806-49fd-a0a7-52e9c68cc521 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:44.268953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc44cd0-6806-49fd-a0a7-52e9c68cc521 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:44.270368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 699/1394] 10.222.0.42 () {54 vars in 967 bytes} [Tue Aug 30 00:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:44.275827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967400c9-a9d0-43bc-aca2-a8d0913436ec None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:44.276330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967400c9-a9d0-43bc-aca2-a8d0913436ec None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:44.276444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967400c9-a9d0-43bc-aca2-a8d0913436ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:44.303962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:44.355798 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-967400c9-a9d0-43bc-aca2-a8d0913436ec None None] MFA Rules not processed for user `4d3160eee18a4f7cb9f6880ec1b672a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:44.356994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-967400c9-a9d0-43bc-aca2-a8d0913436ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:44.436692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 696/1395] 10.222.0.42 () {58 vars in 1064 bytes} [Tue Aug 30 00:29:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:44.444720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc44cd0-6806-49fd-a0a7-52e9c68cc521 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:44.446276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8dc44cd0-6806-49fd-a0a7-52e9c68cc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:44.549127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:44.556619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc44cd0-6806-49fd-a0a7-52e9c68cc521 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:44.634679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0ea9f-6056-4126-ac74-73fa75ecab4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3160eee18a4f7cb9f6880ec1b672a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:44.635286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ea9f-6056-4126-ac74-73fa75ecab4a service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:44.635541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ea9f-6056-4126-ac74-73fa75ecab4a service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:44.635821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ea9f-6056-4126-ac74-73fa75ecab4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:44.637387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c3e0ea9f-6056-4126-ac74-73fa75ecab4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:44.751701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0ea9f-6056-4126-ac74-73fa75ecab4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:44.753134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0ea9f-6056-4126-ac74-73fa75ecab4a service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:44.771698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 700/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:29:45.507634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7196-2f71-4cf7-8f4e-4f5adfeeec1e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:45.508124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7196-2f71-4cf7-8f4e-4f5adfeeec1e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:45.508295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7196-2f71-4cf7-8f4e-4f5adfeeec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:45.576313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-442c7196-2f71-4cf7-8f4e-4f5adfeeec1e None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:45.577970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-442c7196-2f71-4cf7-8f4e-4f5adfeeec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:45.640352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:45.667609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 697/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:45.714084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece49f0-ad08-4e1a-9f69-7d24c7574601 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:45.714555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece49f0-ad08-4e1a-9f69-7d24c7574601 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:45.714665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece49f0-ad08-4e1a-9f69-7d24c7574601 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:45.715991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 701/1398] 10.222.0.42 () {54 vars in 943 bytes} [Tue Aug 30 00:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:45.722512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d961e0-c927-4c37-8ba6-0d84a646af04 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:45.722796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d961e0-c927-4c37-8ba6-0d84a646af04 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:45.723068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d961e0-c927-4c37-8ba6-0d84a646af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:45.802217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-03d961e0-c927-4c37-8ba6-0d84a646af04 None None] MFA Rules not processed for user `5ba04cf2f81b4a33863e0789b706061e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:45.803460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-03d961e0-c927-4c37-8ba6-0d84a646af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:45.924707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 698/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Tue Aug 30 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:45.934137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece49f0-ad08-4e1a-9f69-7d24c7574601 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:45.935884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eece49f0-ad08-4e1a-9f69-7d24c7574601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:45.964704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:46.039592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affaa54-db48-4fcd-a11f-27f28097fa47 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:46.040150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affaa54-db48-4fcd-a11f-27f28097fa47 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:46.040452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affaa54-db48-4fcd-a11f-27f28097fa47 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:46.041874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 699/1400] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:29:46.047046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:46.047557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:46.047679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:46.094963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:46.097812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece49f0-ad08-4e1a-9f69-7d24c7574601 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:46.121975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:46.123588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:46.209923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d95b-723c-4ab4-aaa5-eaf61abcfae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:46.210537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d95b-723c-4ab4-aaa5-eaf61abcfae8 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:46.210817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d95b-723c-4ab4-aaa5-eaf61abcfae8 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:46.211077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d95b-723c-4ab4-aaa5-eaf61abcfae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:46.212799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a2d1d95b-723c-4ab4-aaa5-eaf61abcfae8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:46.220311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:46.234543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 700/1401] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:29:46.295659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d95b-723c-4ab4-aaa5-eaf61abcfae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:46.297276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d95b-723c-4ab4-aaa5-eaf61abcfae8 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:46.305586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 702/1402] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:29:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:29:46.519574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:46.520796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:46.645447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681f06-6c19-47b0-8eb1-a324febf2dbb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:46.649166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:46.783936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40627ce7-30a9-4430-90d6-fb37892c5600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:46.784570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40627ce7-30a9-4430-90d6-fb37892c5600 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:46.784848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40627ce7-30a9-4430-90d6-fb37892c5600 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:46.785113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40627ce7-30a9-4430-90d6-fb37892c5600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:46.786761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-40627ce7-30a9-4430-90d6-fb37892c5600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:46.892261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40627ce7-30a9-4430-90d6-fb37892c5600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:46.893991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40627ce7-30a9-4430-90d6-fb37892c5600 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:46.921907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 701/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:48.869015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e685c-a6f7-42c5-9b11-6e808dfd996b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:48.869647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e685c-a6f7-42c5-9b11-6e808dfd996b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:48.869647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e685c-a6f7-42c5-9b11-6e808dfd996b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:48.871005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 703/1404] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:48.876507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c5b6-6137-423c-b778-f47f7c3cb010 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:48.876937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c5b6-6137-423c-b778-f47f7c3cb010 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:48.877026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c5b6-6137-423c-b778-f47f7c3cb010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:48.888963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:48.950722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a713c5b6-6137-423c-b778-f47f7c3cb010 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:48.951972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a713c5b6-6137-423c-b778-f47f7c3cb010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:49.059461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 702/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:49.354941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e685c-a6f7-42c5-9b11-6e808dfd996b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:49.356469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fe1e685c-a6f7-42c5-9b11-6e808dfd996b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:49.521800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e685c-a6f7-42c5-9b11-6e808dfd996b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:49.524661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:49.649902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e96cc-a21b-4357-b0d4-18ee80447133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:49.650426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e96cc-a21b-4357-b0d4-18ee80447133 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:49.650709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e96cc-a21b-4357-b0d4-18ee80447133 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:49.650982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e96cc-a21b-4357-b0d4-18ee80447133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:49.652591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c7e96cc-a21b-4357-b0d4-18ee80447133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:49.773984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e96cc-a21b-4357-b0d4-18ee80447133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:49.775636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e96cc-a21b-4357-b0d4-18ee80447133 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:49.794572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 704/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:29:51.735461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59303e0-c4ed-4ebd-8ff3-db593b97bcf6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:51.736039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59303e0-c4ed-4ebd-8ff3-db593b97bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:51.736039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59303e0-c4ed-4ebd-8ff3-db593b97bcf6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:51.737365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 703/1407] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:29:51.742666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5d89-2cda-48dd-927a-40e2f68f9fb5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:51.743378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5d89-2cda-48dd-927a-40e2f68f9fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:51.743378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5d89-2cda-48dd-927a-40e2f68f9fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:51.753390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:51.819200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-372c5d89-2cda-48dd-927a-40e2f68f9fb5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:29:51.820434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-372c5d89-2cda-48dd-927a-40e2f68f9fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:51.937581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 705/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:29:52.230046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59303e0-c4ed-4ebd-8ff3-db593b97bcf6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:29:52.231581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a59303e0-c4ed-4ebd-8ff3-db593b97bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:52.335247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:52.413010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59303e0-c4ed-4ebd-8ff3-db593b97bcf6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:29:52.549677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ca771-4340-4cd8-b5da-72e5e804d3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:29:52.550210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ca771-4340-4cd8-b5da-72e5e804d3b4 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:29:52.550493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ca771-4340-4cd8-b5da-72e5e804d3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:29:52.550764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ca771-4340-4cd8-b5da-72e5e804d3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:29:52.555099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-074ca771-4340-4cd8-b5da-72e5e804d3b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:29:52.610239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:29:52.657311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ca771-4340-4cd8-b5da-72e5e804d3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:29:52.659008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ca771-4340-4cd8-b5da-72e5e804d3b4 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:29:52.682791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 704/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:01.932140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=62 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:02.680188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=23 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:08.379856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fb38-c657-4a25-89c6-9865acf07111 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:08.380459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fb38-c657-4a25-89c6-9865acf07111 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:08.380459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fb38-c657-4a25-89c6-9865acf07111 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:08.381775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 706/1410] 10.222.0.42 () {54 vars in 918 bytes} [Tue Aug 30 00:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:08.387000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94a21-406d-475f-9383-2c26b2858590 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:08.387456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94a21-406d-475f-9383-2c26b2858590 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:08.387559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94a21-406d-475f-9383-2c26b2858590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:08.467101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b8d94a21-406d-475f-9383-2c26b2858590 None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:08.468315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b8d94a21-406d-475f-9383-2c26b2858590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:08.597337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 705/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Aug 30 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:08.612189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8cbd-210f-4e3e-9004-1c30a8b5ebd0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:08.612473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8cbd-210f-4e3e-9004-1c30a8b5ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:08.612740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8cbd-210f-4e3e-9004-1c30a8b5ebd0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:08.614100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 707/1412] 10.222.0.42 () {54 vars in 918 bytes} [Tue Aug 30 00:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:08.619144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8168bd-d03f-4020-b86e-12b05d8b7eb1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:08.619426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8168bd-d03f-4020-b86e-12b05d8b7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:08.619696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8168bd-d03f-4020-b86e-12b05d8b7eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:08.696105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:08.699278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4d8168bd-d03f-4020-b86e-12b05d8b7eb1 None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:08.701001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4d8168bd-d03f-4020-b86e-12b05d8b7eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:08.842065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 706/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Aug 30 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:11.211349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511aad-9d21-472d-b340-4d943234edb8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:11.211925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511aad-9d21-472d-b340-4d943234edb8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:11.211925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511aad-9d21-472d-b340-4d943234edb8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:11.213259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:11.218783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc1cc-e022-4fae-bb7e-b7a4b5a6aa6c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:11.219250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc1cc-e022-4fae-bb7e-b7a4b5a6aa6c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:11.219346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc1cc-e022-4fae-bb7e-b7a4b5a6aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:11.288985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8c6cc1cc-e022-4fae-bb7e-b7a4b5a6aa6c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:11.290215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c6cc1cc-e022-4fae-bb7e-b7a4b5a6aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:11.348751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:11.396138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:11.678680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511aad-9d21-472d-b340-4d943234edb8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:11.680214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-14511aad-9d21-472d-b340-4d943234edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:11.826604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511aad-9d21-472d-b340-4d943234edb8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:11.902968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:11.948534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5468eba-e37a-4814-9eb7-ade2a790ff74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:11.949150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468eba-e37a-4814-9eb7-ade2a790ff74 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:11.949427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468eba-e37a-4814-9eb7-ade2a790ff74 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:11.949761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5468eba-e37a-4814-9eb7-ade2a790ff74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:11.951393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5468eba-e37a-4814-9eb7-ade2a790ff74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:12.043011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5468eba-e37a-4814-9eb7-ade2a790ff74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:12.044697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5468eba-e37a-4814-9eb7-ade2a790ff74 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:12.063274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 709/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:12.946847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37234-1ed7-4e71-89fa-d2ad30e5ae37 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:12.947444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37234-1ed7-4e71-89fa-d2ad30e5ae37 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:12.947444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab37234-1ed7-4e71-89fa-d2ad30e5ae37 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:12.948751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:12.954764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbc03-4833-4699-9e40-aeeed37a546e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:12.955224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbc03-4833-4699-9e40-aeeed37a546e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:12.955334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbc03-4833-4699-9e40-aeeed37a546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:13.053162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-295dbc03-4833-4699-9e40-aeeed37a546e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:13.054992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-295dbc03-4833-4699-9e40-aeeed37a546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:13.087328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:13.161010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:13.313973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37234-1ed7-4e71-89fa-d2ad30e5ae37 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:13.316334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9ab37234-1ed7-4e71-89fa-d2ad30e5ae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:13.478047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab37234-1ed7-4e71-89fa-d2ad30e5ae37 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:13.527102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:13.608447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819e798-ce42-4b07-a02c-3b824350215b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:13.609052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e798-ce42-4b07-a02c-3b824350215b service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:13.609322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e798-ce42-4b07-a02c-3b824350215b service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:13.609579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e798-ce42-4b07-a02c-3b824350215b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:13.611195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d819e798-ce42-4b07-a02c-3b824350215b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:13.703380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819e798-ce42-4b07-a02c-3b824350215b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:13.705001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819e798-ce42-4b07-a02c-3b824350215b service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:13.724601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 709/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:14.610811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3e9ce-e309-455b-a56a-d84858d23372 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:14.611679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3e9ce-e309-455b-a56a-d84858d23372 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:14.611679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3e9ce-e309-455b-a56a-d84858d23372 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:14.613849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:14.620541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1151-20a3-45e9-885c-00cbc255cda9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:14.621031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1151-20a3-45e9-885c-00cbc255cda9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:14.621223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1151-20a3-45e9-885c-00cbc255cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:14.698640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:14.723566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4d5d1151-20a3-45e9-885c-00cbc255cda9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:14.724795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4d5d1151-20a3-45e9-885c-00cbc255cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:14.832970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:14.982969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3e9ce-e309-455b-a56a-d84858d23372 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:14.984528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfb3e9ce-e309-455b-a56a-d84858d23372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:15.144086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3e9ce-e309-455b-a56a-d84858d23372 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:15.157214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:15.263098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859cda-f2e5-4510-8ece-b49df21f58ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:15.263634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859cda-f2e5-4510-8ece-b49df21f58ea service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:15.263911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859cda-f2e5-4510-8ece-b49df21f58ea service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:15.264178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859cda-f2e5-4510-8ece-b49df21f58ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:15.265788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f8859cda-f2e5-4510-8ece-b49df21f58ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:15.361398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8859cda-f2e5-4510-8ece-b49df21f58ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:15.363057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8859cda-f2e5-4510-8ece-b49df21f58ea service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:15.382834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 712/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:16.244381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f22c-de28-4b1e-bb47-c6b48b955355 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:16.244969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f22c-de28-4b1e-bb47-c6b48b955355 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:16.244969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02f22c-de28-4b1e-bb47-c6b48b955355 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:16.246721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:16.252274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e88378-cbdc-45d8-8d69-76bd1154cc65 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:16.252692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e88378-cbdc-45d8-8d69-76bd1154cc65 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:16.252802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e88378-cbdc-45d8-8d69-76bd1154cc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:16.273139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:16.332758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c7e88378-cbdc-45d8-8d69-76bd1154cc65 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:16.334015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c7e88378-cbdc-45d8-8d69-76bd1154cc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:16.444711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:16.597489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f22c-de28-4b1e-bb47-c6b48b955355 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:16.599825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6f02f22c-de28-4b1e-bb47-c6b48b955355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:16.717399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:16.754403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02f22c-de28-4b1e-bb47-c6b48b955355 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:16.878794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa5a41-f247-4565-92a5-97ad7f1ecce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:16.879328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5a41-f247-4565-92a5-97ad7f1ecce5 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:16.879610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5a41-f247-4565-92a5-97ad7f1ecce5 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:16.879867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa5a41-f247-4565-92a5-97ad7f1ecce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:16.881469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1aaa5a41-f247-4565-92a5-97ad7f1ecce5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:16.958768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:16.974241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa5a41-f247-4565-92a5-97ad7f1ecce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:16.975829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa5a41-f247-4565-92a5-97ad7f1ecce5 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:16.995572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 712/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:17.868652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68711b-a57c-49d1-a9a4-23f22a28e5a8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:17.869240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68711b-a57c-49d1-a9a4-23f22a28e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:17.869240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68711b-a57c-49d1-a9a4-23f22a28e5a8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:17.871219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:17.877693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1c6b-4250-49e9-b06b-54d7ae98f0f0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:17.878183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1c6b-4250-49e9-b06b-54d7ae98f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:17.878183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1c6b-4250-49e9-b06b-54d7ae98f0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:17.967443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ee3e1c6b-4250-49e9-b06b-54d7ae98f0f0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:17.968644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ee3e1c6b-4250-49e9-b06b-54d7ae98f0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:18.069726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:18.228844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68711b-a57c-49d1-a9a4-23f22a28e5a8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:18.231295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a68711b-a57c-49d1-a9a4-23f22a28e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:18.329718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:18.394731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68711b-a57c-49d1-a9a4-23f22a28e5a8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:18.543351 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61443-afc2-4ec3-b2bf-28ce4a204bef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:18.543878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61443-afc2-4ec3-b2bf-28ce4a204bef service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:18.544173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61443-afc2-4ec3-b2bf-28ce4a204bef service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:18.544429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61443-afc2-4ec3-b2bf-28ce4a204bef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:18.546062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d1a61443-afc2-4ec3-b2bf-28ce4a204bef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:18.596709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:18.637939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a61443-afc2-4ec3-b2bf-28ce4a204bef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:18.639568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a61443-afc2-4ec3-b2bf-28ce4a204bef service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:18.657451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 715/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:19.478780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ca80d-0c43-4a96-8a0a-999edd74efdf None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:19.479695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ca80d-0c43-4a96-8a0a-999edd74efdf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:19.479695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ca80d-0c43-4a96-8a0a-999edd74efdf None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:19.481834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:19.490253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b5a3-a7e8-4c00-a1cb-4f130ec20d26 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:19.491282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b5a3-a7e8-4c00-a1cb-4f130ec20d26 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:19.491282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b5a3-a7e8-4c00-a1cb-4f130ec20d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:19.578669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e844b5a3-a7e8-4c00-a1cb-4f130ec20d26 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:19.579932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e844b5a3-a7e8-4c00-a1cb-4f130ec20d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:19.683137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:19.837154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ca80d-0c43-4a96-8a0a-999edd74efdf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:19.838762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a23ca80d-0c43-4a96-8a0a-999edd74efdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:19.889497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:19.988370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ca80d-0c43-4a96-8a0a-999edd74efdf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:20.110767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a98166-d48b-4826-9d45-02f270460c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:20.111380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98166-d48b-4826-9d45-02f270460c0f service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:20.111650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98166-d48b-4826-9d45-02f270460c0f service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:20.111910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98166-d48b-4826-9d45-02f270460c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:20.113512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9a98166-d48b-4826-9d45-02f270460c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:20.127024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:20.211071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a98166-d48b-4826-9d45-02f270460c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:20.213724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a98166-d48b-4826-9d45-02f270460c0f service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:20.233096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 715/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:21.057975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b979-47a2-45ab-865d-8e5a572c1cb4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:21.058857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b979-47a2-45ab-865d-8e5a572c1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:21.058857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b979-47a2-45ab-865d-8e5a572c1cb4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:21.061063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:21.069803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031f329-6888-48b4-8f4d-8be1cb90505e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:21.070242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031f329-6888-48b4-8f4d-8be1cb90505e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:21.070394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031f329-6888-48b4-8f4d-8be1cb90505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:21.163609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f031f329-6888-48b4-8f4d-8be1cb90505e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:21.164752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f031f329-6888-48b4-8f4d-8be1cb90505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:21.241454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:21.278527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:21.433613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526b979-47a2-45ab-865d-8e5a572c1cb4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:21.435797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0526b979-47a2-45ab-865d-8e5a572c1cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:21.455217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:21.609123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526b979-47a2-45ab-865d-8e5a572c1cb4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:21.706181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:21.734887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc2e66-0451-4d46-9bcc-81fa5d55a6a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:21.735504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc2e66-0451-4d46-9bcc-81fa5d55a6a6 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:21.735789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc2e66-0451-4d46-9bcc-81fa5d55a6a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:21.736088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc2e66-0451-4d46-9bcc-81fa5d55a6a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:21.737738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1dbc2e66-0451-4d46-9bcc-81fa5d55a6a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:21.844078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc2e66-0451-4d46-9bcc-81fa5d55a6a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:21.845743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc2e66-0451-4d46-9bcc-81fa5d55a6a6 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:21.864077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 718/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:22.668312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28567-dc38-48bf-b28d-10015d11d8a7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:22.668862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28567-dc38-48bf-b28d-10015d11d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:22.668862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28567-dc38-48bf-b28d-10015d11d8a7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:22.670155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:22.676309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8bf14-866a-4c63-83a2-52538edc1b5d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:22.676987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8bf14-866a-4c63-83a2-52538edc1b5d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:22.677221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8bf14-866a-4c63-83a2-52538edc1b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:22.767798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-65c8bf14-866a-4c63-83a2-52538edc1b5d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:22.769082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-65c8bf14-866a-4c63-83a2-52538edc1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:22.815992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:22.874624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:23.031411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f28567-dc38-48bf-b28d-10015d11d8a7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:23.032932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-82f28567-dc38-48bf-b28d-10015d11d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:23.202107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f28567-dc38-48bf-b28d-10015d11d8a7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:23.259790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:23.332918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f78483-08f6-4aff-b345-29323285f0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:23.333452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78483-08f6-4aff-b345-29323285f0eb service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:23.333757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78483-08f6-4aff-b345-29323285f0eb service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:23.334021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78483-08f6-4aff-b345-29323285f0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:23.335615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c4f78483-08f6-4aff-b345-29323285f0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:23.440710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f78483-08f6-4aff-b345-29323285f0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:23.442443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f78483-08f6-4aff-b345-29323285f0eb service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:23.464447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 718/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:24.281981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f98b-d6e6-4150-a963-c6b6886f487f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:24.282928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f98b-d6e6-4150-a963-c6b6886f487f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:24.282928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f98b-d6e6-4150-a963-c6b6886f487f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:24.285507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:30:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:24.290504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b65f58-f2ba-4f9e-8076-1ba2a9abb54a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:24.290954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b65f58-f2ba-4f9e-8076-1ba2a9abb54a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:24.291050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b65f58-f2ba-4f9e-8076-1ba2a9abb54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:24.368792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e3b65f58-f2ba-4f9e-8076-1ba2a9abb54a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:24.370037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e3b65f58-f2ba-4f9e-8076-1ba2a9abb54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:24.372106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:24.474700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:24.633811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0f98b-d6e6-4150-a963-c6b6886f487f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:24.635997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-12b0f98b-d6e6-4150-a963-c6b6886f487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:24.804449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0f98b-d6e6-4150-a963-c6b6886f487f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:24.835288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:24.930119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fcb44-c3c5-41be-a3b6-c00792a33501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:24.930661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fcb44-c3c5-41be-a3b6-c00792a33501 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:24.930963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fcb44-c3c5-41be-a3b6-c00792a33501 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:24.931229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fcb44-c3c5-41be-a3b6-c00792a33501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:24.932959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-205fcb44-c3c5-41be-a3b6-c00792a33501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:25.038757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fcb44-c3c5-41be-a3b6-c00792a33501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:25.040386 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fcb44-c3c5-41be-a3b6-c00792a33501 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:25.058375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 721/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:26.884512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc979a-b548-4289-8931-91462574c7b2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:26.885068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc979a-b548-4289-8931-91462574c7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:26.885068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc979a-b548-4289-8931-91462574c7b2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:26.886440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:26.892571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4d81-c2bc-4c1a-a95f-189f05664369 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:26.893018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4d81-c2bc-4c1a-a95f-189f05664369 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:26.893129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4d81-c2bc-4c1a-a95f-189f05664369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:26.942399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:26.972046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-489a4d81-c2bc-4c1a-a95f-189f05664369 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:26.973273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-489a4d81-c2bc-4c1a-a95f-189f05664369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:27.085138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:27.369995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc979a-b548-4289-8931-91462574c7b2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:27.371523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-86bc979a-b548-4289-8931-91462574c7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:27.483603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc979a-b548-4289-8931-91462574c7b2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:27.519060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:27.562470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10a97-04bf-4047-b8e4-f5654676abad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:27.563064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10a97-04bf-4047-b8e4-f5654676abad service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:27.563334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10a97-04bf-4047-b8e4-f5654676abad service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:27.563599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10a97-04bf-4047-b8e4-f5654676abad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:27.565314 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-84f10a97-04bf-4047-b8e4-f5654676abad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:27.810214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10a97-04bf-4047-b8e4-f5654676abad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:27.811959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f10a97-04bf-4047-b8e4-f5654676abad service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:27.831475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 721/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:29.916229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a7164-e841-4777-8544-483900b18ae3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:29.916785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a7164-e841-4777-8544-483900b18ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:29.916785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a7164-e841-4777-8544-483900b18ae3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:29.922255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:29.923662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8368c-04f8-4b07-8ed0-dca51f6684a0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:29.924085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8368c-04f8-4b07-8ed0-dca51f6684a0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:29.924187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8368c-04f8-4b07-8ed0-dca51f6684a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:30.006001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a7e8368c-04f8-4b07-8ed0-dca51f6684a0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:30.007557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a7e8368c-04f8-4b07-8ed0-dca51f6684a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:30.021230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:30.114877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:30:30.402855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a7164-e841-4777-8544-483900b18ae3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:30.404444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d88a7164-e841-4777-8544-483900b18ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:30.513675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a7164-e841-4777-8544-483900b18ae3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:30.526554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:30.591587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af58db8-afdf-4560-9b91-60eaf4e5d4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:30.592791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58db8-afdf-4560-9b91-60eaf4e5d4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:30.593485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58db8-afdf-4560-9b91-60eaf4e5d4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:30.593793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58db8-afdf-4560-9b91-60eaf4e5d4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:30.595551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9af58db8-afdf-4560-9b91-60eaf4e5d4e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:30.706836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af58db8-afdf-4560-9b91-60eaf4e5d4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:30.708292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af58db8-afdf-4560-9b91-60eaf4e5d4e5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:30.728195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 724/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:32.996278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e0723-a6b8-48df-a4ca-4c938de99122 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:32.996880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e0723-a6b8-48df-a4ca-4c938de99122 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:32.996880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e0723-a6b8-48df-a4ca-4c938de99122 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:32.998760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:33.004338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94080e0-75aa-4126-b39d-4f47db5778ac None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:33.004790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94080e0-75aa-4126-b39d-4f47db5778ac None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:33.004885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94080e0-75aa-4126-b39d-4f47db5778ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:33.055832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:33.075432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e94080e0-75aa-4126-b39d-4f47db5778ac None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:33.076676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e94080e0-75aa-4126-b39d-4f47db5778ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:33.181654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:33.457129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e0723-a6b8-48df-a4ca-4c938de99122 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:33.458770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6b1e0723-a6b8-48df-a4ca-4c938de99122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:33.566704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e0723-a6b8-48df-a4ca-4c938de99122 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:33.606305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:33.643604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca7bab-fc4c-45e6-b96b-747d18afbab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:33.644176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca7bab-fc4c-45e6-b96b-747d18afbab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:33.644446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca7bab-fc4c-45e6-b96b-747d18afbab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:33.644708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca7bab-fc4c-45e6-b96b-747d18afbab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:33.646343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-24ca7bab-fc4c-45e6-b96b-747d18afbab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:33.762300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca7bab-fc4c-45e6-b96b-747d18afbab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:33.763672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca7bab-fc4c-45e6-b96b-747d18afbab0 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:33.783522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 724/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:35.819495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f4983-e36d-4d13-b52f-01bbcf0ee909 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:35.820499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f4983-e36d-4d13-b52f-01bbcf0ee909 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:35.820499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f4983-e36d-4d13-b52f-01bbcf0ee909 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:35.822400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:35.831414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457ddfe-4893-46d4-82b1-ebd8a80a5c07 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:35.831848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457ddfe-4893-46d4-82b1-ebd8a80a5c07 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:35.831997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457ddfe-4893-46d4-82b1-ebd8a80a5c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:35.921894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2457ddfe-4893-46d4-82b1-ebd8a80a5c07 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:35.923489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2457ddfe-4893-46d4-82b1-ebd8a80a5c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:35.954341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:36.038131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:36.321586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f4983-e36d-4d13-b52f-01bbcf0ee909 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:36.324009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-752f4983-e36d-4d13-b52f-01bbcf0ee909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:36.434132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f4983-e36d-4d13-b52f-01bbcf0ee909 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:36.454638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:36.510085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad617c-a728-4c9a-87c2-7cd76d204b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:36.510696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad617c-a728-4c9a-87c2-7cd76d204b8e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:36.511135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad617c-a728-4c9a-87c2-7cd76d204b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:36.511416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad617c-a728-4c9a-87c2-7cd76d204b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:36.513041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fdad617c-a728-4c9a-87c2-7cd76d204b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:36.622944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad617c-a728-4c9a-87c2-7cd76d204b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:36.624454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad617c-a728-4c9a-87c2-7cd76d204b8e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:36.643272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 727/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:38.617046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb626a-cc54-41b8-93fa-7353d962e29d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:38.617660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb626a-cc54-41b8-93fa-7353d962e29d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:38.617660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb626a-cc54-41b8-93fa-7353d962e29d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:38.618949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:38.624723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e9e35-84a9-4dea-bbcf-8956a67ed205 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:38.625152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e9e35-84a9-4dea-bbcf-8956a67ed205 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:38.625264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e9e35-84a9-4dea-bbcf-8956a67ed205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:38.690049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:38.695251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e17e9e35-84a9-4dea-bbcf-8956a67ed205 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:38.696822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e17e9e35-84a9-4dea-bbcf-8956a67ed205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:38.801236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:39.093222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb626a-cc54-41b8-93fa-7353d962e29d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:39.095819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8fb626a-cc54-41b8-93fa-7353d962e29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:39.212935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb626a-cc54-41b8-93fa-7353d962e29d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:39.265335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:39.292013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9aef0-1943-4976-90c2-e7906d92331a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:39.292620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9aef0-1943-4976-90c2-e7906d92331a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:39.292897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9aef0-1943-4976-90c2-e7906d92331a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:39.293166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9aef0-1943-4976-90c2-e7906d92331a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:39.294791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-def9aef0-1943-4976-90c2-e7906d92331a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:39.418826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9aef0-1943-4976-90c2-e7906d92331a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:39.420303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9aef0-1943-4976-90c2-e7906d92331a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:39.439729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 727/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:41.466643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7450798-5bfd-4434-9502-d1557719fc58 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:41.467333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7450798-5bfd-4434-9502-d1557719fc58 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:41.467333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7450798-5bfd-4434-9502-d1557719fc58 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:41.468582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:41.474159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6188-a325-40fa-b6cb-30422f81fd4b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:41.474589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6188-a325-40fa-b6cb-30422f81fd4b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:41.474707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6188-a325-40fa-b6cb-30422f81fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:41.550179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-015a6188-a325-40fa-b6cb-30422f81fd4b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:41.551999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-015a6188-a325-40fa-b6cb-30422f81fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:41.590939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:41.661081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:41.963236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7450798-5bfd-4434-9502-d1557719fc58 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:41.965744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f7450798-5bfd-4434-9502-d1557719fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:42.084977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7450798-5bfd-4434-9502-d1557719fc58 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:42.114525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:42.163939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbd4ed-8449-451d-ad80-89c7fd3ae552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:42.164548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbd4ed-8449-451d-ad80-89c7fd3ae552 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:42.164830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbd4ed-8449-451d-ad80-89c7fd3ae552 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:42.165139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbd4ed-8449-451d-ad80-89c7fd3ae552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:42.166770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8ffbd4ed-8449-451d-ad80-89c7fd3ae552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:42.280676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbd4ed-8449-451d-ad80-89c7fd3ae552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:42.282007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbd4ed-8449-451d-ad80-89c7fd3ae552 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:42.300229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 730/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:44.254226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c4b8-a367-4efb-9191-6fa4d24066d5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:44.254792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c4b8-a367-4efb-9191-6fa4d24066d5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:44.254792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c4b8-a367-4efb-9191-6fa4d24066d5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:44.256852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:44.262585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591504b-0754-4db1-91ba-e43279b1edc1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:44.263028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591504b-0754-4db1-91ba-e43279b1edc1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:44.263121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591504b-0754-4db1-91ba-e43279b1edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:44.335911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7591504b-0754-4db1-91ba-e43279b1edc1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:44.337763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7591504b-0754-4db1-91ba-e43279b1edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:44.350064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:44.446655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:44.741497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c4b8-a367-4efb-9191-6fa4d24066d5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:44.744690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6663c4b8-a367-4efb-9191-6fa4d24066d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:44.859705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c4b8-a367-4efb-9191-6fa4d24066d5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:44.927324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:44.947100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d85f8-2d8e-4906-89b0-78db066cf6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:44.947714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d85f8-2d8e-4906-89b0-78db066cf6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:44.947989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d85f8-2d8e-4906-89b0-78db066cf6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:44.948251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d85f8-2d8e-4906-89b0-78db066cf6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:44.949913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2b6d85f8-2d8e-4906-89b0-78db066cf6b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:45.067394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d85f8-2d8e-4906-89b0-78db066cf6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:45.068739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d85f8-2d8e-4906-89b0-78db066cf6b1 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:45.087275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 730/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:47.070097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0551d-199b-436e-9afb-55dee0994fc7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:47.070669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0551d-199b-436e-9afb-55dee0994fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:47.070669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0551d-199b-436e-9afb-55dee0994fc7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:47.072899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:47.079190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6f21a-7f2a-4ce7-bd1d-dd29e8206977 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:47.079972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6f21a-7f2a-4ce7-bd1d-dd29e8206977 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:47.080173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6f21a-7f2a-4ce7-bd1d-dd29e8206977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:47.155050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-44f6f21a-7f2a-4ce7-bd1d-dd29e8206977 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:47.156170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-44f6f21a-7f2a-4ce7-bd1d-dd29e8206977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:47.194969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:47.264178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:47.554148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0551d-199b-436e-9afb-55dee0994fc7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:47.556410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fbe0551d-199b-436e-9afb-55dee0994fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:47.684095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0551d-199b-436e-9afb-55dee0994fc7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:47.723596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:47.761908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a75fb-3523-4bbb-9438-a1076e832abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:47.762503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a75fb-3523-4bbb-9438-a1076e832abf service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:47.762785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a75fb-3523-4bbb-9438-a1076e832abf service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:47.763052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a75fb-3523-4bbb-9438-a1076e832abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:47.764639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9a4a75fb-3523-4bbb-9438-a1076e832abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:47.885183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a75fb-3523-4bbb-9438-a1076e832abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:47.886585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a75fb-3523-4bbb-9438-a1076e832abf service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:47.904785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 733/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:49.814805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de758-cb96-4e80-9212-0da0869f4015 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:49.815809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de758-cb96-4e80-9212-0da0869f4015 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:49.815809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de758-cb96-4e80-9212-0da0869f4015 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:49.817806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:49.826544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec81fad-f453-4d69-b97d-af1dd4d8b9a4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:49.827044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec81fad-f453-4d69-b97d-af1dd4d8b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:49.827147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec81fad-f453-4d69-b97d-af1dd4d8b9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:49.904102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cec81fad-f453-4d69-b97d-af1dd4d8b9a4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:49.905334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cec81fad-f453-4d69-b97d-af1dd4d8b9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:49.926594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:50.011162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:50.298087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de758-cb96-4e80-9212-0da0869f4015 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:50.299630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a55de758-cb96-4e80-9212-0da0869f4015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:50.413354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de758-cb96-4e80-9212-0da0869f4015 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:50.485837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:50.493727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac8bfc-6311-486b-98b3-b937cb6367ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:50.494427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8bfc-6311-486b-98b3-b937cb6367ab service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:50.494704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8bfc-6311-486b-98b3-b937cb6367ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:50.494967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8bfc-6311-486b-98b3-b937cb6367ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:50.496569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-64ac8bfc-6311-486b-98b3-b937cb6367ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:50.616911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac8bfc-6311-486b-98b3-b937cb6367ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:50.618563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac8bfc-6311-486b-98b3-b937cb6367ab service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:50.638597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 733/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:30:52.547567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881996fd-5978-4491-bd4b-0ab0996cbf7e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:52.548186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881996fd-5978-4491-bd4b-0ab0996cbf7e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:52.548186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881996fd-5978-4491-bd4b-0ab0996cbf7e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:52.549482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:30:52.555953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20baa9e-00a0-4537-97e1-aaf9cbafe91a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:52.556708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20baa9e-00a0-4537-97e1-aaf9cbafe91a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:52.556844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20baa9e-00a0-4537-97e1-aaf9cbafe91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:52.641179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b20baa9e-00a0-4537-97e1-aaf9cbafe91a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:30:52.642368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b20baa9e-00a0-4537-97e1-aaf9cbafe91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:52.693048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:52.743620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:30:53.022878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881996fd-5978-4491-bd4b-0ab0996cbf7e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:30:53.024427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-881996fd-5978-4491-bd4b-0ab0996cbf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:53.141268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881996fd-5978-4491-bd4b-0ab0996cbf7e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:30:53.188867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:30:53.225074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c09af-cea8-4e5f-b363-0c4dbd17f1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:30:53.225727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c09af-cea8-4e5f-b363-0c4dbd17f1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:30:53.226010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c09af-cea8-4e5f-b363-0c4dbd17f1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:30:53.226283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c09af-cea8-4e5f-b363-0c4dbd17f1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:30:53.227890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-240c09af-cea8-4e5f-b363-0c4dbd17f1c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:30:53.346899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c09af-cea8-4e5f-b363-0c4dbd17f1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:30:53.348295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c09af-cea8-4e5f-b363-0c4dbd17f1c4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:30:53.367465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 736/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:31:02.741735 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=22 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:03.364845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=66 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:12.854868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775b2c3-3019-4856-b2bc-2974bcffefce None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:12.855262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775b2c3-3019-4856-b2bc-2974bcffefce None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:12.855365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775b2c3-3019-4856-b2bc-2974bcffefce None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:12.857388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 735/1471] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:31:12.862800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81c4e6-edda-49e4-83c0-9f464d5ea7fd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:12.863280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81c4e6-edda-49e4-83c0-9f464d5ea7fd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:12.863376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81c4e6-edda-49e4-83c0-9f464d5ea7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:12.931456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2e81c4e6-edda-49e4-83c0-9f464d5ea7fd None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:12.932674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2e81c4e6-edda-49e4-83c0-9f464d5ea7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:13.044235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 737/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:31:13.342772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f618ce-ce8a-487f-9888-537a8f2bb9e6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:13.343104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f618ce-ce8a-487f-9888-537a8f2bb9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:13.343492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f618ce-ce8a-487f-9888-537a8f2bb9e6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:13.345569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 736/1473] 10.222.0.42 () {54 vars in 967 bytes} [Tue Aug 30 00:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:31:13.350710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8645c47-8171-4b44-a8ae-f085d7c56bf6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:13.350987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8645c47-8171-4b44-a8ae-f085d7c56bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:13.351283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8645c47-8171-4b44-a8ae-f085d7c56bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:13.433333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d8645c47-8171-4b44-a8ae-f085d7c56bf6 None None] MFA Rules not processed for user `4d3160eee18a4f7cb9f6880ec1b672a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:13.434598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d8645c47-8171-4b44-a8ae-f085d7c56bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:13.456713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:13.523099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 738/1474] 10.222.0.42 () {58 vars in 1064 bytes} [Tue Aug 30 00:31:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:31:13.531219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f618ce-ce8a-487f-9888-537a8f2bb9e6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:31:13.532718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-85f618ce-ce8a-487f-9888-537a8f2bb9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:13.643703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f618ce-ce8a-487f-9888-537a8f2bb9e6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:31:13.727785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98430180-0a03-42e2-96c4-97810407f936 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3160eee18a4f7cb9f6880ec1b672a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:31:13.728388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98430180-0a03-42e2-96c4-97810407f936 service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:13.728669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98430180-0a03-42e2-96c4-97810407f936 service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:13.728930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98430180-0a03-42e2-96c4-97810407f936 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:13.730567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-98430180-0a03-42e2-96c4-97810407f936 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:13.785900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:13.845311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98430180-0a03-42e2-96c4-97810407f936 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:31:13.846810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98430180-0a03-42e2-96c4-97810407f936 service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:31:13.866111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 737/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:31:15.859973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc407a-d2c6-45f9-aef3-6672ded0cf61 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:15.860574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc407a-d2c6-45f9-aef3-6672ded0cf61 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:15.860574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc407a-d2c6-45f9-aef3-6672ded0cf61 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:15.862164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 739/1476] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:31:15.868791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5c3b-1cfb-4b9c-85ae-b22fdf41b204 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:15.869521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5c3b-1cfb-4b9c-85ae-b22fdf41b204 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:15.869746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5c3b-1cfb-4b9c-85ae-b22fdf41b204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:15.939792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c55f5c3b-1cfb-4b9c-85ae-b22fdf41b204 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:15.941012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c55f5c3b-1cfb-4b9c-85ae-b22fdf41b204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:16.048510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 738/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:31:16.317622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc407a-d2c6-45f9-aef3-6672ded0cf61 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:31:16.320012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ddc407a-d2c6-45f9-aef3-6672ded0cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:16.471254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc407a-d2c6-45f9-aef3-6672ded0cf61 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:31:16.521078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:16.568404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc06f43-34f8-401f-91dc-8fed2b4c7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:31:16.569013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc06f43-34f8-401f-91dc-8fed2b4c7a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:16.569286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc06f43-34f8-401f-91dc-8fed2b4c7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:16.569531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc06f43-34f8-401f-91dc-8fed2b4c7a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:16.570192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc06f43-34f8-401f-91dc-8fed2b4c7a31 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:31:16.571966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-7dc06f43-34f8-401f-91dc-8fed2b4c7a31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:31:16.571966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:31:16.571966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:31:16.573116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc06f43-34f8-401f-91dc-8fed2b4c7a31 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:31:16.592425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 740/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Aug 30 00:31:16 2022] GET /identity/v3/projects => generated 2553 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:31:18.525597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89d56-f46b-4b71-8e28-9691234e4556 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:18.526158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89d56-f46b-4b71-8e28-9691234e4556 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:18.526158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da89d56-f46b-4b71-8e28-9691234e4556 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:18.527502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 739/1479] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:31:18.533944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc279-4658-418a-9eb6-76f240c21d12 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:18.534714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc279-4658-418a-9eb6-76f240c21d12 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:18.534885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc279-4658-418a-9eb6-76f240c21d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:18.610958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-88edc279-4658-418a-9eb6-76f240c21d12 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:18.612197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-88edc279-4658-418a-9eb6-76f240c21d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:18.711237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 741/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:31:19.016046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da89d56-f46b-4b71-8e28-9691234e4556 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:31:19.017596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5da89d56-f46b-4b71-8e28-9691234e4556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:19.030706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:19.177560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da89d56-f46b-4b71-8e28-9691234e4556 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:31:19.262831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:19.298037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0566f4-0289-4005-bf19-1c6442fc25d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:31:19.298646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0566f4-0289-4005-bf19-1c6442fc25d9 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:19.298921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0566f4-0289-4005-bf19-1c6442fc25d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:19.299186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0566f4-0289-4005-bf19-1c6442fc25d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:19.300801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6a0566f4-0289-4005-bf19-1c6442fc25d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:19.407010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0566f4-0289-4005-bf19-1c6442fc25d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:31:19.408628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0566f4-0289-4005-bf19-1c6442fc25d9 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:31:19.427951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 740/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:31:21.514104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8462b8-f041-4072-97f5-0d0112f63493 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:21.514679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8462b8-f041-4072-97f5-0d0112f63493 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:21.514679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8462b8-f041-4072-97f5-0d0112f63493 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:21.515932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 742/1482] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:31:21.521854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5864a-64ab-4580-b260-36783500c40c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:21.522348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5864a-64ab-4580-b260-36783500c40c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:21.522348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5864a-64ab-4580-b260-36783500c40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:21.591563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3cb5864a-64ab-4580-b260-36783500c40c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:21.592765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3cb5864a-64ab-4580-b260-36783500c40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:21.641060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:21.692471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 741/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:31:21.992440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8462b8-f041-4072-97f5-0d0112f63493 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:31:21.994910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c8462b8-f041-4072-97f5-0d0112f63493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:22.021782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:22.105954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8462b8-f041-4072-97f5-0d0112f63493 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:31:22.186738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356faed-a901-4275-bdaa-8b3277844b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:31:22.187341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356faed-a901-4275-bdaa-8b3277844b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:22.187616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356faed-a901-4275-bdaa-8b3277844b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:22.187891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356faed-a901-4275-bdaa-8b3277844b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:22.189490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4356faed-a901-4275-bdaa-8b3277844b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:22.392307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:22.431712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356faed-a901-4275-bdaa-8b3277844b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:31:22.433879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356faed-a901-4275-bdaa-8b3277844b37 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:31:22.453153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 743/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:31:24.408906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389324a2-8b87-4e5e-b9fd-54612a19572e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:24.409399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389324a2-8b87-4e5e-b9fd-54612a19572e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:24.409504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389324a2-8b87-4e5e-b9fd-54612a19572e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:24.411511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 742/1485] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:31:24.416987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23e3ee-4a07-4b19-8324-5ec54bb46eff None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:24.417502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23e3ee-4a07-4b19-8324-5ec54bb46eff None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:24.417502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23e3ee-4a07-4b19-8324-5ec54bb46eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:24.487654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2c23e3ee-4a07-4b19-8324-5ec54bb46eff None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:24.488860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2c23e3ee-4a07-4b19-8324-5ec54bb46eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:24.591252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 744/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:31:24.875549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389324a2-8b87-4e5e-b9fd-54612a19572e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:31:24.877132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-389324a2-8b87-4e5e-b9fd-54612a19572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:24.982140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389324a2-8b87-4e5e-b9fd-54612a19572e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:31:25.058638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:25.060881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af615d33-d4f0-4d6b-8202-0b4634847da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:31:25.061504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af615d33-d4f0-4d6b-8202-0b4634847da1 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:25.061826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af615d33-d4f0-4d6b-8202-0b4634847da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:25.062100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af615d33-d4f0-4d6b-8202-0b4634847da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:25.064408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-af615d33-d4f0-4d6b-8202-0b4634847da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:25.182177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af615d33-d4f0-4d6b-8202-0b4634847da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:31:25.183621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af615d33-d4f0-4d6b-8202-0b4634847da1 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:31:25.203063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 743/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:31:27.203764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5018c2-91d6-43f8-acaf-114bbc05ccc9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:27.204363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5018c2-91d6-43f8-acaf-114bbc05ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:27.204363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5018c2-91d6-43f8-acaf-114bbc05ccc9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:27.205700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 745/1488] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:31:27.211900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f166ace-1ddf-4c9e-a2e6-2cd098b26423 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:27.212627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f166ace-1ddf-4c9e-a2e6-2cd098b26423 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:27.212787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f166ace-1ddf-4c9e-a2e6-2cd098b26423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:27.299115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1f166ace-1ddf-4c9e-a2e6-2cd098b26423 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:27.300882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1f166ace-1ddf-4c9e-a2e6-2cd098b26423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:27.363452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:27.410189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 744/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:31:27.699572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5018c2-91d6-43f8-acaf-114bbc05ccc9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:31:27.702356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5b5018c2-91d6-43f8-acaf-114bbc05ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:27.747260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:27.824939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5018c2-91d6-43f8-acaf-114bbc05ccc9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:31:27.909210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e270b91-3cf6-47ee-a73c-d61595bf4a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:31:27.909842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270b91-3cf6-47ee-a73c-d61595bf4a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:27.910121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270b91-3cf6-47ee-a73c-d61595bf4a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:27.910384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270b91-3cf6-47ee-a73c-d61595bf4a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:27.911976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e270b91-3cf6-47ee-a73c-d61595bf4a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:28.001772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:28.035531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e270b91-3cf6-47ee-a73c-d61595bf4a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:31:28.036981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e270b91-3cf6-47ee-a73c-d61595bf4a77 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:31:28.055265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 746/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:31:30.268385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1100-eb5c-4385-a887-77c57cdce66f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:30.268998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1100-eb5c-4385-a887-77c57cdce66f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:30.268998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded1100-eb5c-4385-a887-77c57cdce66f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:30.270307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 745/1491] 10.222.0.42 () {54 vars in 927 bytes} [Tue Aug 30 00:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:31:30.275642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c303-4079-4fde-a03d-2ff65b069e17 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:30.276101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c303-4079-4fde-a03d-2ff65b069e17 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:30.276210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c303-4079-4fde-a03d-2ff65b069e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:30.357234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d3d9c303-4079-4fde-a03d-2ff65b069e17 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:31:30.358639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d3d9c303-4079-4fde-a03d-2ff65b069e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:30.458549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 747/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Aug 30 00:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:31:30.743194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded1100-eb5c-4385-a887-77c57cdce66f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:31:30.745612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eded1100-eb5c-4385-a887-77c57cdce66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:30.859892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded1100-eb5c-4385-a887-77c57cdce66f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:31:30.940376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b1b5-9622-48cb-bca8-44281cf2722a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:31:30.940974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b1b5-9622-48cb-bca8-44281cf2722a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:31:30.941243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b1b5-9622-48cb-bca8-44281cf2722a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:31:30.941504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b1b5-9622-48cb-bca8-44281cf2722a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:31:30.943117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f254b1b5-9622-48cb-bca8-44281cf2722a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:31:30.952644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:31.058408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b1b5-9622-48cb-bca8-44281cf2722a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:31:31.059814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b1b5-9622-48cb-bca8-44281cf2722a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:31:31.078491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 746/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:31:40.456557 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:31:41.076179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=50 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:04.634767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:04.635693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:04.635693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:04.724405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:33:04.725659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:04.834223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 748/1494] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:33:04.842862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098341-cbd6-43e5-849e-e06ee3b380fc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:04.843380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098341-cbd6-43e5-849e-e06ee3b380fc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:04.843380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098341-cbd6-43e5-849e-e06ee3b380fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:04.923846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-00098341-cbd6-43e5-849e-e06ee3b380fc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:33:04.925046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-00098341-cbd6-43e5-849e-e06ee3b380fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:05.032219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 747/1495] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:33:05.039613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:05.041324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:05.054945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7df00-b77a-4384-a696-8df4b40e4ae3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:05.121786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:05.165180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:05.166061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:05.166341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:05.166807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:05.167455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:33:05.167773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:05.169368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:05.169368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:33:05.169368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:33:05.170298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:05.182299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 749/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:33:05.190964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00098341-cbd6-43e5-849e-e06ee3b380fc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:05.200675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00098341-cbd6-43e5-849e-e06ee3b380fc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:05.268133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:05.315875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:05.316454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:05.316773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:05.317098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:05.317795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:05.319595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:05.319595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: warnings.warn(msg) Aug 30 00:33:05.319595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: Aug 30 00:33:05.320786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:05.388303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 748/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:33:05 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:33:05.392425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:05.394017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:05.430113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b437f-7fed-43c9-b585-5e4b3a333486 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:05.528822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:05.529428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:05.529748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:05.530015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:05.530698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:05.531705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:05.531705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:33:05.531705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:33:05.532914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:05.579220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 750/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:33:05 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:33:05.583450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:05.584992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:05.654306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8463aa-7832-47fe-9637-105252dc6104 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:05.744199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:05.756264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:05.756885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:05.757157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:05.757418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:05.758100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:05.759148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:05.759148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: warnings.warn(msg) Aug 30 00:33:05.759148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: Aug 30 00:33:05.760043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:05.773357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 749/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:33:05.778287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:05.780402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:05.797628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224b1f2-8fed-46e1-9b95-b59dad7bd29b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:05.825421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:05.899287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620639d-d0ec-4bcf-b70f-f5ce6bb2c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:05.899887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620639d-d0ec-4bcf-b70f-f5ce6bb2c520 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:05.900183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620639d-d0ec-4bcf-b70f-f5ce6bb2c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:05.900444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620639d-d0ec-4bcf-b70f-f5ce6bb2c520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:05.901072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620639d-d0ec-4bcf-b70f-f5ce6bb2c520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:05.902120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-f620639d-d0ec-4bcf-b70f-f5ce6bb2c520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:05.902120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:33:05.902120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:33:05.903012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620639d-d0ec-4bcf-b70f-f5ce6bb2c520 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:05.916302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 751/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:33:05.920617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:05.922423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:05.956702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5327c2-5f8d-4cfa-9588-00e5273c44e4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:06.054977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db728a9-9a32-44e9-9f09-4084a71f6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:06.055652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db728a9-9a32-44e9-9f09-4084a71f6e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:06.055922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db728a9-9a32-44e9-9f09-4084a71f6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:06.056208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db728a9-9a32-44e9-9f09-4084a71f6e95 admin admin] PATH_INFO: `/v3/projects/bd383ab509ec47b9b55dde722efdb7b4/users/18a873f74a7c485cb7d63aac2ce624c4/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:06.078752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db728a9-9a32-44e9-9f09-4084a71f6e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd383ab509ec47b9b55dde722efdb7b4, user_id=18a873f74a7c485cb7d63aac2ce624c4, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:06.079762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-4db728a9-9a32-44e9-9f09-4084a71f6e95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:06.079762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: warnings.warn(msg) Aug 30 00:33:06.079762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: Aug 30 00:33:06.081701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db728a9-9a32-44e9-9f09-4084a71f6e95 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:06.111651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 750/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:33:05 2022] PUT /identity/v3/projects/bd383ab509ec47b9b55dde722efdb7b4/users/18a873f74a7c485cb7d63aac2ce624c4/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:33:06.125286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c2ff-a4b9-4a9f-b9a5-c41cb1e7cb0b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:06.125690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c2ff-a4b9-4a9f-b9a5-c41cb1e7cb0b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:06.125956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c2ff-a4b9-4a9f-b9a5-c41cb1e7cb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:06.192713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-06d5c2ff-a4b9-4a9f-b9a5-c41cb1e7cb0b None None] MFA Rules not processed for user `18a873f74a7c485cb7d63aac2ce624c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:33:06.193985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-06d5c2ff-a4b9-4a9f-b9a5-c41cb1e7cb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:06.275757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 752/1502] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:33:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:33:06.289932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7e29-abf2-4783-b946-5d1cf8aa6bc3 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:06.290196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7e29-abf2-4783-b946-5d1cf8aa6bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:06.290467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7e29-abf2-4783-b946-5d1cf8aa6bc3 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:06.291842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 751/1503] 10.222.0.42 () {54 vars in 964 bytes} [Tue Aug 30 00:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:33:06.296819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00378509-1e73-4c2a-9d3b-98058bf88afe None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:06.297107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00378509-1e73-4c2a-9d3b-98058bf88afe None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:06.297383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00378509-1e73-4c2a-9d3b-98058bf88afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:06.329111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:06.376935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-00378509-1e73-4c2a-9d3b-98058bf88afe None None] MFA Rules not processed for user `5301330fc789466ab0c1c4aae41b6330`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:33:06.378282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-00378509-1e73-4c2a-9d3b-98058bf88afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:06.455836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 753/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Aug 30 00:33:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:33:06.463728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7e29-abf2-4783-b946-5d1cf8aa6bc3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:06.465223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-28eb7e29-abf2-4783-b946-5d1cf8aa6bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:06.518933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:06.577195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7e29-abf2-4783-b946-5d1cf8aa6bc3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:06.656370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:06.656940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:06.657224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:06.657488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:06.659138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:06.771472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:06.772816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:06.776610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:06.793808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 752/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:33:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:33:06.845959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c5cd-ca2a-4c60-96aa-97902edfeb1e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:06.846424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c5cd-ca2a-4c60-96aa-97902edfeb1e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:06.846526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845c5cd-ca2a-4c60-96aa-97902edfeb1e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:06.847774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 754/1506] 10.222.0.42 () {52 vars in 830 bytes} [Tue Aug 30 00:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:33:06.852829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:06.854758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:06.972176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725960d-2b21-4f65-81d1-9363daac7857 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:07.071495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:07.072033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:07.072312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:07.072553 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] PATH_INFO: `/v3/users/18a873f74a7c485cb7d63aac2ce624c4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:07.086882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a873f74a7c485cb7d63aac2ce624c4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:07.088236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:07.088236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: warnings.warn(msg) Aug 30 00:33:07.088236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: Aug 30 00:33:07.089457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:07.101477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:07.177250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a873f74a7c485cb7d63aac2ce624c4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:07.201578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a873f74a7c485cb7d63aac2ce624c4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:07.215819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a873f74a7c485cb7d63aac2ce624c4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:07.216285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a873f74a7c485cb7d63aac2ce624c4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:07.216806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a873f74a7c485cb7d63aac2ce624c4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:07.233711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 753/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:33:06 2022] DELETE /identity/v3/users/18a873f74a7c485cb7d63aac2ce624c4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:33:07.238295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:07.238575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:07.238843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:07.302400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:33:07.304660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:07.383369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:07.396723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 755/1508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:33:07.410662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:07.412454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:07.519656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606d768-ddaa-4d74-8661-855cbb26ad66 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:07.575991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:07.597083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6af19f-5996-4fbe-bd5b-046561883ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:07.597742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6af19f-5996-4fbe-bd5b-046561883ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:07.598020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6af19f-5996-4fbe-bd5b-046561883ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:07.598303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6af19f-5996-4fbe-bd5b-046561883ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:07.599925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8f6af19f-5996-4fbe-bd5b-046561883ad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:07.715047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6af19f-5996-4fbe-bd5b-046561883ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:07.716487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6af19f-5996-4fbe-bd5b-046561883ad5 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:07.737164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 754/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:33:08.174029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:33:08.175264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:33:08.187083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00075f-161a-4bda-8b8f-d8ba35c73d08 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:33:08.288070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:33:08.288606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:33:08.288882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:33:08.289150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] PATH_INFO: `/v3/projects/bd383ab509ec47b9b55dde722efdb7b4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:33:08.301937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd383ab509ec47b9b55dde722efdb7b4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:33:08.303472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:33:08.303472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:33:08.303472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:33:08.305245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:33:08.369366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd383ab509ec47b9b55dde722efdb7b4', 'request_id': 'req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:08.377063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd383ab509ec47b9b55dde722efdb7b4', 'request_id': 'req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:08.387255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd383ab509ec47b9b55dde722efdb7b4', 'request_id': 'req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:08.419155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] The token cache is being invalidate because project bd383ab509ec47b9b55dde722efdb7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:33:08.419444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:08.419968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cf404f8-7c5e-4f9b-9fee-caadb91ad599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:33:08.421483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 756/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:33:08 2022] DELETE /identity/v3/projects/bd383ab509ec47b9b55dde722efdb7b4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:33:17.734144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=62 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:33:18.417078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:34:51.504217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bc42-899d-4c71-a562-4c852e9b103f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:51.504853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bc42-899d-4c71-a562-4c852e9b103f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:51.504853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bc42-899d-4c71-a562-4c852e9b103f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:51.506160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:34:51.512146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec682e8-4c80-40d6-8545-e97cf87f9197 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:51.512848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec682e8-4c80-40d6-8545-e97cf87f9197 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:51.513002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec682e8-4c80-40d6-8545-e97cf87f9197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:51.605111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6ec682e8-4c80-40d6-8545-e97cf87f9197 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:34:51.606356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ec682e8-4c80-40d6-8545-e97cf87f9197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:34:51.715187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:34:51.873878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66bc42-899d-4c71-a562-4c852e9b103f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:34:51.876351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c66bc42-899d-4c71-a562-4c852e9b103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:34:52.014517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66bc42-899d-4c71-a562-4c852e9b103f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:34:52.020882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1a901-7194-42e4-af88-9662548b3b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:34:52.021570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a901-7194-42e4-af88-9662548b3b10 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:52.021849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a901-7194-42e4-af88-9662548b3b10 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:52.022112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a901-7194-42e4-af88-9662548b3b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:52.031843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1a901-7194-42e4-af88-9662548b3b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:34:52.033479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1a901-7194-42e4-af88-9662548b3b10 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:34:52.043565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 756/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:34:52.888099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7671-87f0-47bd-9b48-291c1b2d9dcc None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:52.889026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7671-87f0-47bd-9b48-291c1b2d9dcc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:52.889026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7671-87f0-47bd-9b48-291c1b2d9dcc None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:52.891242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:34:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:34:52.899207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b732-206d-440a-8004-5fa220828901 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:52.900142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b732-206d-440a-8004-5fa220828901 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:52.900275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b732-206d-440a-8004-5fa220828901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:52.920710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1bc8b732-206d-440a-8004-5fa220828901 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:34:52.921888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1bc8b732-206d-440a-8004-5fa220828901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:34:52.930483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:34:53.090807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e7671-87f0-47bd-9b48-291c1b2d9dcc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:34:53.112070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e7671-87f0-47bd-9b48-291c1b2d9dcc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:34:53.118041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc26dcd-f34e-4ef1-817d-5b392aa0076d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:34:53.118977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26dcd-f34e-4ef1-817d-5b392aa0076d service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:53.119262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26dcd-f34e-4ef1-817d-5b392aa0076d service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:53.119534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26dcd-f34e-4ef1-817d-5b392aa0076d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:53.128041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc26dcd-f34e-4ef1-817d-5b392aa0076d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:34:53.129676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc26dcd-f34e-4ef1-817d-5b392aa0076d service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:34:53.139208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 759/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:34:53.887802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef84a1-7dfa-4ed4-9c04-527b19a7820b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:53.888087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef84a1-7dfa-4ed4-9c04-527b19a7820b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:53.888347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef84a1-7dfa-4ed4-9c04-527b19a7820b None None] PATH_INFO: `/v3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:53.889694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 758/1517] 10.222.0.72 () {54 vars in 925 bytes} [Tue Aug 30 00:34:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:34:53.896303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3a2fd-6d30-4931-b22a-315fe594d7dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:53.896806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3a2fd-6d30-4931-b22a-315fe594d7dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:53.896806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3a2fd-6d30-4931-b22a-315fe594d7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:53.960026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-abb3a2fd-6d30-4931-b22a-315fe594d7dd None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:34:53.961255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-abb3a2fd-6d30-4931-b22a-315fe594d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:34:53.979660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:34:54.037839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 760/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Aug 30 00:34:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:34:57.938543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0828-427b-4de0-bf92-d28b65f27eb9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:57.939411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0828-427b-4de0-bf92-d28b65f27eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:57.939411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0828-427b-4de0-bf92-d28b65f27eb9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:57.941378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 759/1519] 10.222.0.42 () {54 vars in 961 bytes} [Tue Aug 30 00:34:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:34:57.947424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ac24-05be-4b98-afc8-62aef4639cfb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:57.948192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ac24-05be-4b98-afc8-62aef4639cfb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:57.948383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66ac24-05be-4b98-afc8-62aef4639cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:57.974969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4a66ac24-05be-4b98-afc8-62aef4639cfb None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:34:57.976161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a66ac24-05be-4b98-afc8-62aef4639cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:34:57.986156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 761/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Aug 30 00:34:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:34:57.994065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0828-427b-4de0-bf92-d28b65f27eb9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:34:58.009302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0828-427b-4de0-bf92-d28b65f27eb9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:34:58.015255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d020e-c65d-46f3-8b67-3cd8b4f5b2c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:34:58.015825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d020e-c65d-46f3-8b67-3cd8b4f5b2c3 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:34:58.016102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d020e-c65d-46f3-8b67-3cd8b4f5b2c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:34:58.016369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d020e-c65d-46f3-8b67-3cd8b4f5b2c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:34:58.024763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d020e-c65d-46f3-8b67-3cd8b4f5b2c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:34:58.026394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d020e-c65d-46f3-8b67-3cd8b4f5b2c3 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:34:58.036168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 760/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:34:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:35:04.404969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa66db-983e-435f-bae4-9d53604ff0c5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:04.405437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa66db-983e-435f-bae4-9d53604ff0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:04.405583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa66db-983e-435f-bae4-9d53604ff0c5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:04.406923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:35:04.412672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e10cc-396b-432a-8ed3-da2fc8923161 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:04.413166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e10cc-396b-432a-8ed3-da2fc8923161 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:04.413279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e10cc-396b-432a-8ed3-da2fc8923161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:04.435246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-790e10cc-396b-432a-8ed3-da2fc8923161 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:35:04.436469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-790e10cc-396b-432a-8ed3-da2fc8923161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:04.445323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:35:04.613615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa66db-983e-435f-bae4-9d53604ff0c5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:35:04.630556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa66db-983e-435f-bae4-9d53604ff0c5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:35:04.636799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f2747-0fcc-4aee-9a01-26cd87cd8293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:35:04.637397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f2747-0fcc-4aee-9a01-26cd87cd8293 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:04.637713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f2747-0fcc-4aee-9a01-26cd87cd8293 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:04.637981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f2747-0fcc-4aee-9a01-26cd87cd8293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:04.647305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f2747-0fcc-4aee-9a01-26cd87cd8293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:35:04.648828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f2747-0fcc-4aee-9a01-26cd87cd8293 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:35:04.658995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 763/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:35:05.489387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cf50-cc9a-4b13-bdf8-02f929bcea7b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:05.489884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cf50-cc9a-4b13-bdf8-02f929bcea7b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:05.489884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9cf50-cc9a-4b13-bdf8-02f929bcea7b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:05.491551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:35:05.497047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad286ad-09af-402c-8c41-b8410b22068b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:05.497600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad286ad-09af-402c-8c41-b8410b22068b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:05.497600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad286ad-09af-402c-8c41-b8410b22068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:05.517581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7ad286ad-09af-402c-8c41-b8410b22068b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:35:05.518875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7ad286ad-09af-402c-8c41-b8410b22068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:05.528413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:35:05.686597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9cf50-cc9a-4b13-bdf8-02f929bcea7b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:35:05.702932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9cf50-cc9a-4b13-bdf8-02f929bcea7b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:35:05.709836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbf28d-ca1b-4f39-b005-6557395937bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:35:05.710405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbf28d-ca1b-4f39-b005-6557395937bf service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:05.710688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbf28d-ca1b-4f39-b005-6557395937bf service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:05.710945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbf28d-ca1b-4f39-b005-6557395937bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:05.719508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbf28d-ca1b-4f39-b005-6557395937bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:35:05.721092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbf28d-ca1b-4f39-b005-6557395937bf service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:35:05.730840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 763/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:35:09.340056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3550812-0c33-45d9-9497-59f453cdff9f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:09.340608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3550812-0c33-45d9-9497-59f453cdff9f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:09.340608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3550812-0c33-45d9-9497-59f453cdff9f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:09.341945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:35:09.348223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbf2a-e54e-4804-a10c-7d65e4e80e92 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:09.348970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbf2a-e54e-4804-a10c-7d65e4e80e92 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:09.349116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbf2a-e54e-4804-a10c-7d65e4e80e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:09.377564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4b8dbf2a-e54e-4804-a10c-7d65e4e80e92 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:35:09.378802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4b8dbf2a-e54e-4804-a10c-7d65e4e80e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:09.387511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:35:09.670701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3550812-0c33-45d9-9497-59f453cdff9f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:35:09.672787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a3550812-0c33-45d9-9497-59f453cdff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:09.771204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3550812-0c33-45d9-9497-59f453cdff9f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:35:09.775025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c10964-af33-4c35-a0b0-cf65b7eb5660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:35:09.775637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10964-af33-4c35-a0b0-cf65b7eb5660 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:09.775917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10964-af33-4c35-a0b0-cf65b7eb5660 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:09.776188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10964-af33-4c35-a0b0-cf65b7eb5660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:09.785451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c10964-af33-4c35-a0b0-cf65b7eb5660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:35:09.786921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c10964-af33-4c35-a0b0-cf65b7eb5660 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:35:09.796305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 766/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:35:11.697633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b438-c2e9-4773-941f-ef2c9d1aacd9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:11.698648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b438-c2e9-4773-941f-ef2c9d1aacd9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:11.698648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b438-c2e9-4773-941f-ef2c9d1aacd9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:11.700819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:35:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:35:11.709525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99771df-c273-4d01-bb1a-4165c3eb78a8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:11.710332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99771df-c273-4d01-bb1a-4165c3eb78a8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:11.710515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99771df-c273-4d01-bb1a-4165c3eb78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:11.732018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b99771df-c273-4d01-bb1a-4165c3eb78a8 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:35:11.733244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b99771df-c273-4d01-bb1a-4165c3eb78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:11.741957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:35:12.032582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3b438-c2e9-4773-941f-ef2c9d1aacd9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:35:12.034748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6bf3b438-c2e9-4773-941f-ef2c9d1aacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:12.049138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3b438-c2e9-4773-941f-ef2c9d1aacd9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:35:12.052911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31332d40-ad1a-46b8-973f-bdde3604a126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:35:12.053503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31332d40-ad1a-46b8-973f-bdde3604a126 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:12.053811 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31332d40-ad1a-46b8-973f-bdde3604a126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:12.054085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31332d40-ad1a-46b8-973f-bdde3604a126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:12.063106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31332d40-ad1a-46b8-973f-bdde3604a126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:35:12.064522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31332d40-ad1a-46b8-973f-bdde3604a126 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:35:12.074080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 766/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:35:15.732413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e087e52-df2f-4b2d-b09b-584edbcbf090 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:15.733388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e087e52-df2f-4b2d-b09b-584edbcbf090 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:15.733388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e087e52-df2f-4b2d-b09b-584edbcbf090 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:15.735806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:35:15.745324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef881af-209c-4ce8-9f50-36f241e51c77 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:15.746155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef881af-209c-4ce8-9f50-36f241e51c77 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:15.746340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef881af-209c-4ce8-9f50-36f241e51c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:15.772623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0ef881af-209c-4ce8-9f50-36f241e51c77 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:35:15.773872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0ef881af-209c-4ce8-9f50-36f241e51c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:15.782999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:35:16.342830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e087e52-df2f-4b2d-b09b-584edbcbf090 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:35:16.345896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e087e52-df2f-4b2d-b09b-584edbcbf090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:16.419867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:35:16.433930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e087e52-df2f-4b2d-b09b-584edbcbf090 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:35:16.437909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911dd17-5c42-4c1e-a931-dc8734362236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:35:16.438595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911dd17-5c42-4c1e-a931-dc8734362236 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:16.438845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911dd17-5c42-4c1e-a931-dc8734362236 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:16.439112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911dd17-5c42-4c1e-a931-dc8734362236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:16.448274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911dd17-5c42-4c1e-a931-dc8734362236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:35:16.449767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911dd17-5c42-4c1e-a931-dc8734362236 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:35:16.459172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 769/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:35:18.355588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e75c6e-767e-4c19-acbc-78f39cec5410 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:18.356198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e75c6e-767e-4c19-acbc-78f39cec5410 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:18.356198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e75c6e-767e-4c19-acbc-78f39cec5410 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:18.358313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:35:18.367203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142789b-eb73-4000-b2e7-24668d09f0ce None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:18.367634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142789b-eb73-4000-b2e7-24668d09f0ce None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:18.368182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142789b-eb73-4000-b2e7-24668d09f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:18.389749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7142789b-eb73-4000-b2e7-24668d09f0ce None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:35:18.390970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7142789b-eb73-4000-b2e7-24668d09f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:18.406552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:35:18.954331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e75c6e-767e-4c19-acbc-78f39cec5410 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:35:18.957632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0e75c6e-767e-4c19-acbc-78f39cec5410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:35:18.968774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:35:18.975932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e75c6e-767e-4c19-acbc-78f39cec5410 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:35:18.981921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3103134-2ee4-41d6-8b63-0abc89ef65ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:35:18.982799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103134-2ee4-41d6-8b63-0abc89ef65ae service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:35:18.983132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103134-2ee4-41d6-8b63-0abc89ef65ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:35:18.983504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3103134-2ee4-41d6-8b63-0abc89ef65ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:35:18.998254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3103134-2ee4-41d6-8b63-0abc89ef65ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:35:18.999689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3103134-2ee4-41d6-8b63-0abc89ef65ae service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:35:19.009859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 769/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:35:28.384516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=11 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:35:29.005567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:46.572153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf96d-3a79-42c6-bf25-b47844082601 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:46.572866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf96d-3a79-42c6-bf25-b47844082601 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:46.572866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf96d-3a79-42c6-bf25-b47844082601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:46.602235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-165cf96d-3a79-42c6-bf25-b47844082601 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:46.603455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-165cf96d-3a79-42c6-bf25-b47844082601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:46.620767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 771/1540] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:46.629915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498ae18-a78c-4d6e-817c-5191cf02a7ae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:46.630950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498ae18-a78c-4d6e-817c-5191cf02a7ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:46.630950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498ae18-a78c-4d6e-817c-5191cf02a7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:46.657423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c498ae18-a78c-4d6e-817c-5191cf02a7ae None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:46.658846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c498ae18-a78c-4d6e-817c-5191cf02a7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:46.673268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 770/1541] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:46.677917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf96d-3a79-42c6-bf25-b47844082601 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:46.692308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf96d-3a79-42c6-bf25-b47844082601 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:46.702582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:46.704094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:46.704599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:46.705098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:46.708166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:46.708764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:46.710710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:46.728309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 772/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:36:46.736990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498ae18-a78c-4d6e-817c-5191cf02a7ae None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:46.751751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498ae18-a78c-4d6e-817c-5191cf02a7ae None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:46.761703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2af8e9-2e1d-4dcd-8d95-6de50fe09de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:46.762333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af8e9-2e1d-4dcd-8d95-6de50fe09de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:46.762602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af8e9-2e1d-4dcd-8d95-6de50fe09de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:46.762869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af8e9-2e1d-4dcd-8d95-6de50fe09de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:46.763522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2af8e9-2e1d-4dcd-8d95-6de50fe09de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:46.765422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2af8e9-2e1d-4dcd-8d95-6de50fe09de3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:46.823919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 771/1543] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:46 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:46.831026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:46.849346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76587e0b-38a8-4f88-9e53-d880a82ac080 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:46.854770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873439b-b5ee-4245-a1c5-874416da1de9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:46.855666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873439b-b5ee-4245-a1c5-874416da1de9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:46.856166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873439b-b5ee-4245-a1c5-874416da1de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:46.904262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3873439b-b5ee-4245-a1c5-874416da1de9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:46.909476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3873439b-b5ee-4245-a1c5-874416da1de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.003133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.003763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.004043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.004312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.004957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.008186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.029228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 772/1544] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.039633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dc12-cb38-43cc-a0c9-1e6150a46002 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.040378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dc12-cb38-43cc-a0c9-1e6150a46002 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.040859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9dc12-cb38-43cc-a0c9-1e6150a46002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.053572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 773/1545] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:46 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:47.054262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.075879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a1c9dc12-cb38-43cc-a0c9-1e6150a46002 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.077249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a1c9dc12-cb38-43cc-a0c9-1e6150a46002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.080761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8f167-6f79-4742-9837-a8f032992cc5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.093934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 773/1546] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.099494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9dc12-cb38-43cc-a0c9-1e6150a46002 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.106413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.107053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.107337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.107609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.108916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.111412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.114113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9dc12-cb38-43cc-a0c9-1e6150a46002 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.123323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.123959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.124282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.124552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.126352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:47.126658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.127833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:36:47.127833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: warnings.warn(msg) Aug 30 00:36:47.127833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: Aug 30 00:36:47.128735 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.142188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 774/1547] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:47.146718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.155831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 774/1548] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:36:47.164524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.168390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05d96-a879-4d65-966b-399ffa319e78 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.180452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d328-f36e-451a-a077-d44852920c45 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.182541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b903d-4597-476a-bfa2-78dd583d3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.183173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b903d-4597-476a-bfa2-78dd583d3a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.183452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b903d-4597-476a-bfa2-78dd583d3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.183738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b903d-4597-476a-bfa2-78dd583d3a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.184544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b903d-4597-476a-bfa2-78dd583d3a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.186193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b903d-4597-476a-bfa2-78dd583d3a65 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.193650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.194365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.194640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.194906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.195777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.198066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.201270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 775/1549] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:47.205232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1b0c-d8a3-4ea3-8e1e-2a3cc1ba9a4b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.205519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1b0c-d8a3-4ea3-8e1e-2a3cc1ba9a4b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.205819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1b0c-d8a3-4ea3-8e1e-2a3cc1ba9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.245456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 775/1550] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:36:47.246969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-717e1b0c-d8a3-4ea3-8e1e-2a3cc1ba9a4b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.248336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.248470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-717e1b0c-d8a3-4ea3-8e1e-2a3cc1ba9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.349992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c9cb-31d1-42b3-88d4-52cc8fe8df7f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.362636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff97b5b-9826-4b10-b64e-b54341feb983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.363364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97b5b-9826-4b10-b64e-b54341feb983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.363599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97b5b-9826-4b10-b64e-b54341feb983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.363918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff97b5b-9826-4b10-b64e-b54341feb983 admin admin] PATH_INFO: `/v3/projects/3da0b589db1a4f748f472693ef9041a0/users/2532defc863d4fbe8885c6f38169b5c8/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.385232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 776/1551] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.385232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1b0c-d8a3-4ea3-8e1e-2a3cc1ba9a4b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.386919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff97b5b-9826-4b10-b64e-b54341feb983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da0b589db1a4f748f472693ef9041a0, user_id=2532defc863d4fbe8885c6f38169b5c8, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.390862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff97b5b-9826-4b10-b64e-b54341feb983 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.393413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1b0c-d8a3-4ea3-8e1e-2a3cc1ba9a4b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.398568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3fac-a254-4d4d-845b-df3b42928477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.399176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3fac-a254-4d4d-845b-df3b42928477 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.399454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3fac-a254-4d4d-845b-df3b42928477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.399740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3fac-a254-4d4d-845b-df3b42928477 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.400547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3fac-a254-4d4d-845b-df3b42928477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.402500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3fac-a254-4d4d-845b-df3b42928477 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.406448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 776/1552] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:47 2022] PUT /identity/v3/projects/3da0b589db1a4f748f472693ef9041a0/users/2532defc863d4fbe8885c6f38169b5c8/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:47.407791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025247-9690-4bee-8099-453398dbc1d5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.408097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025247-9690-4bee-8099-453398dbc1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.408407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025247-9690-4bee-8099-453398dbc1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.419337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:47.431483 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-90025247-9690-4bee-8099-453398dbc1d5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.431976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 777/1553] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/users => generated 303 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:47.433295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d39cd-ca71-4bc7-98e5-7c3e1fedfc22 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.433596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d39cd-ca71-4bc7-98e5-7c3e1fedfc22 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.433864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d39cd-ca71-4bc7-98e5-7c3e1fedfc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.435992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-90025247-9690-4bee-8099-453398dbc1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.459590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f15d39cd-ca71-4bc7-98e5-7c3e1fedfc22 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.460801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f15d39cd-ca71-4bc7-98e5-7c3e1fedfc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.487213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:47.499380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 777/1554] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.500960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c855-519c-4d9a-8371-ed4804d21b48 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.500960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c855-519c-4d9a-8371-ed4804d21b48 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.501179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000c855-519c-4d9a-8371-ed4804d21b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.521302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 778/1555] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.522722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da16b0-8d54-4747-a64f-ac64ef4e553e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.523095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da16b0-8d54-4747-a64f-ac64ef4e553e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.523456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da16b0-8d54-4747-a64f-ac64ef4e553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.523555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2000c855-519c-4d9a-8371-ed4804d21b48 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.524648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2000c855-519c-4d9a-8371-ed4804d21b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.536331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 778/1556] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.538040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b16cb-26d2-45ac-b88f-745ba4d1bef1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.538344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b16cb-26d2-45ac-b88f-745ba4d1bef1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.538722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b16cb-26d2-45ac-b88f-745ba4d1bef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.545677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-70da16b0-8d54-4747-a64f-ac64ef4e553e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.546865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-70da16b0-8d54-4747-a64f-ac64ef4e553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.554911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 779/1557] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.556260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b2bd-1965-466d-b111-d36319c129f4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.556671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b2bd-1965-466d-b111-d36319c129f4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.557086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b2bd-1965-466d-b111-d36319c129f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.559851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3f4b16cb-26d2-45ac-b88f-745ba4d1bef1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.561044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3f4b16cb-26d2-45ac-b88f-745ba4d1bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.569126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 779/1558] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.569957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b16cb-26d2-45ac-b88f-745ba4d1bef1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.579430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b16cb-26d2-45ac-b88f-745ba4d1bef1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.580282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ebe1b2bd-1965-466d-b111-d36319c129f4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.581527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ebe1b2bd-1965-466d-b111-d36319c129f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.584095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29512ec-322f-4121-8c60-50aa0289865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.584696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29512ec-322f-4121-8c60-50aa0289865d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.584950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29512ec-322f-4121-8c60-50aa0289865d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.585229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29512ec-322f-4121-8c60-50aa0289865d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.585903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29512ec-322f-4121-8c60-50aa0289865d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.587481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29512ec-322f-4121-8c60-50aa0289865d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.589259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 780/1559] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.590475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b41b-96df-4711-b525-773cad0d0cbb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.590744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b41b-96df-4711-b525-773cad0d0cbb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.591016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b41b-96df-4711-b525-773cad0d0cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.598882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 780/1560] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:47.603047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab0609-6dee-49d7-a272-a038ef30f8c0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.603331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab0609-6dee-49d7-a272-a038ef30f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.603772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab0609-6dee-49d7-a272-a038ef30f8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.610415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-de87b41b-96df-4711-b525-773cad0d0cbb None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.611616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-de87b41b-96df-4711-b525-773cad0d0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.619861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 781/1561] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.621049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f38f-6f2d-4b15-aec6-e531f4c79b24 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.621383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f38f-6f2d-4b15-aec6-e531f4c79b24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.621636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f38f-6f2d-4b15-aec6-e531f4c79b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.623511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-71ab0609-6dee-49d7-a272-a038ef30f8c0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.624690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-71ab0609-6dee-49d7-a272-a038ef30f8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.632594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 781/1562] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.633791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b6906-3083-441c-a4cf-e98c9c33eef5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.634026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b6906-3083-441c-a4cf-e98c9c33eef5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.634329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b6906-3083-441c-a4cf-e98c9c33eef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.642723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b706f38f-6f2d-4b15-aec6-e531f4c79b24 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.643920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b706f38f-6f2d-4b15-aec6-e531f4c79b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.652239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 782/1563] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.653527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18a0b-6341-4658-9e1c-a9aed631f917 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.653839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18a0b-6341-4658-9e1c-a9aed631f917 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.654164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18a0b-6341-4658-9e1c-a9aed631f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.654854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-220b6906-3083-441c-a4cf-e98c9c33eef5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.656074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-220b6906-3083-441c-a4cf-e98c9c33eef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.664613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 782/1564] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.666442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b6906-3083-441c-a4cf-e98c9c33eef5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.673803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4bc18a0b-6341-4658-9e1c-a9aed631f917 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.674935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4bc18a0b-6341-4658-9e1c-a9aed631f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.676296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b6906-3083-441c-a4cf-e98c9c33eef5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.681712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.682382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.682658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.682928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.683081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 783/1565] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.683566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:47.683796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18a0b-6341-4658-9e1c-a9aed631f917 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.683912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.685435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.697806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 783/1566] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:36:47.698661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.708468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6edbbf-f5b3-452e-b7b5-c437dd9141a2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.713461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3acaf-a8be-4fa2-bb46-96f058b4ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.714097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3acaf-a8be-4fa2-bb46-96f058b4ef23 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.714437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3acaf-a8be-4fa2-bb46-96f058b4ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.714640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3acaf-a8be-4fa2-bb46-96f058b4ef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.715336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3acaf-a8be-4fa2-bb46-96f058b4ef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.716920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3acaf-a8be-4fa2-bb46-96f058b4ef23 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.727350 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 784/1567] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:47.730852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadea265-6a38-47af-b127-049983979ebe None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.730852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadea265-6a38-47af-b127-049983979ebe None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.730852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadea265-6a38-47af-b127-049983979ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.744814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18a0b-6341-4658-9e1c-a9aed631f917 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.748424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.749036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.749157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-eadea265-6a38-47af-b127-049983979ebe None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:47.749316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.749608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.750313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eadea265-6a38-47af-b127-049983979ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:47.759253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.759517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 785/1568] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:47.760281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadea265-6a38-47af-b127-049983979ebe None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.763847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.769719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadea265-6a38-47af-b127-049983979ebe None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.773955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 784/1569] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:47.774692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.774819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.775316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.776623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.776623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.777070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:47.777344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.779074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.785067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259f6ef-c132-47ba-9924-4086d9a87942 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.790606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.791490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.791851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.792281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.792762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:47.793226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.801128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 786/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:36:47.801342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.801460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.812592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8a47-d1bc-446d-b63a-737732529fa1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.819231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 785/1571] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:36:47.819231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.819509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.819509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.819509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.819509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.820096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:47.820297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.821940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.832393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef9701-820c-49ef-b091-9737aefc1dbc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.835031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 787/1572] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:36:47.842191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.845226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.846003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.846348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.846683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.847393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:47.847503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3d0c5-623e-4162-929c-cf38fbc717d3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.847815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.849453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.853927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.854602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.854980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.855458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.856187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.859093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.863664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 786/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:36:47.870726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.883549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d0891-901a-49ca-af4a-43b218fa3c2e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.888280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:47.888940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:47.889222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:47.889483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] PATH_INFO: `/v3/projects/b6d0f3796564460eb3efeb39cf10b0c8/users/a538539e3a5e423e9c84cef3f8bede2f/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:47.894066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 788/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:47.894904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.906503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d0f3796564460eb3efeb39cf10b0c8, user_id=a538539e3a5e423e9c84cef3f8bede2f, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:47.907558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:36:47.907558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:36:47.907558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:36:47.910039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:47.926013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 787/1575] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:47 2022] PUT /identity/v3/projects/b6d0f3796564460eb3efeb39cf10b0c8/users/a538539e3a5e423e9c84cef3f8bede2f/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:47.927278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:47.959241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:47.982613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e2673-70a4-4e9b-828f-c24218d0a3b1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:47.990036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:48.005191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1332fb0-3132-4441-8cd9-70c5d09008ce admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.011880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.012606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.012955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.013292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.014035 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.015121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:36:48.015121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:36:48.015121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:36:48.016554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.047798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 788/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.047798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.055899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.056531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.056846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.057115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.057951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:36:48.058402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.060719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.075510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 789/1577] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:36:48.076853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.088557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b117733-aa12-487e-b703-7ea1084093f4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.115703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5883e4c-7302-46a9-9d73-5de977718dd4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.122657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.123274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.123550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.124336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.125083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.127617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.163181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 789/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.163603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.164284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.164560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.164831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.165054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.165472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.168498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.205481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 790/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.210302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.238700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba895491-3232-4dc8-ab98-bfb4536b817d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.283587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ae332-1083-4442-94f1-b9924d626aaa admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.289432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d605d3-ae44-4f86-884f-2285728f2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.289709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d605d3-ae44-4f86-884f-2285728f2593 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.289918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d605d3-ae44-4f86-884f-2285728f2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.290193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d605d3-ae44-4f86-884f-2285728f2593 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.290807 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d605d3-ae44-4f86-884f-2285728f2593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.291992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-b2d605d3-ae44-4f86-884f-2285728f2593 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:36:48.291992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: warnings.warn(msg) Aug 30 00:36:48.291992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: Aug 30 00:36:48.293212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d605d3-ae44-4f86-884f-2285728f2593 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.308891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.309683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.310039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.310508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.311235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.313222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.320596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 791/1580] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.320596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b252f8-4de3-417b-8ab0-0a896e904154 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.320596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b252f8-4de3-417b-8ab0-0a896e904154 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.320596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b252f8-4de3-417b-8ab0-0a896e904154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.327781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:48.335008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:48.340388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-95b252f8-4de3-417b-8ab0-0a896e904154 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:48.341674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-95b252f8-4de3-417b-8ab0-0a896e904154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:48.352850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 792/1581] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:48.353036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 790/1582] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/projects => generated 391 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.353132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b252f8-4de3-417b-8ab0-0a896e904154 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.353209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.363120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b252f8-4de3-417b-8ab0-0a896e904154 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.430175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.430738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.431015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.431285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.431747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec487a-6a85-4090-83c8-df7a14cdf4a2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.431969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.434095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.436725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.437422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.437783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.438113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.438802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.440753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.460593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 793/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.462456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.475346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccaed3-d41e-4c81-a3f1-0b8c1771b839 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.480726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.481364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.481669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.481787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 791/1584] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.481942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.482658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.482818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.484883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.515312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 794/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.518687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.532279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e656819-6cea-47a4-bca3-75b3963bf470 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.577326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a7806-37e1-41c8-ad95-7bb0a5b90338 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.583183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.584267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.584441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.584832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.585655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.588161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.598588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.599368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.599646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.599919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.600571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.602292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.616192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 795/1586] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.616192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.618491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 792/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.619370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.633129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93becb0c-d1dd-49e9-90c0-b71cdc4de7c1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.638496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.639266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.639646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.640017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.640990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.643149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.680762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 796/1588] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/users => generated 296 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.680762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.687379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862be6-ae29-482c-904a-6d8fbe2aaef4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.692377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dd1df-1517-4756-a505-f5c7610e72a7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.692978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.693807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.694095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.694361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.697900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.699795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.700461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.700955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.701862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.704267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.712545 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.714074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.722891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 797/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.724269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.731225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 793/1590] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:48.732440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.734803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027c456-2890-4fb0-ab84-a1c1756d48de admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.739829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.741052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.741326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.741946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.743113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.745063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.745286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd132b0-f02d-4a90-8a2a-35c67159d1ca service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.751520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.753139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.753682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.754103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.755066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.757009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.770663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:48.779725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 798/1591] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:48 2022] POST /identity/v3/users => generated 290 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:48.782371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.783029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 794/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.784443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.797853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1741f5-0ba9-4260-b983-2197290abc2d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.801343 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec32713-6733-4f0c-bdcc-0b82fe4b3046 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.805407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.806167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.806547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.807449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.807682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.809497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.813302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.813956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.814361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.815186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.815798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.818796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.833928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 799/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.834624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 795/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.835460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.838959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.851328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db9337-73ba-4438-9591-4e88e9949ed6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.854477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdb537-431a-4e55-b873-d4a20db86095 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.858117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.858939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.859414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.859822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.860509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.860791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.861374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.861879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.862362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.863326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.863786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.865552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.868781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:48.879151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 796/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.880023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.890303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 800/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.891551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.901899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3586c-a089-4214-9ef4-6f7aadcc1d7d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.906509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59c5d2-abab-48f5-982b-fff1007adfbd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.906848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.907790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.907790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.908922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.909601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.911333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.911912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.912524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.912803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.913072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.913884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.915657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.925711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 801/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.929467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.930181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 797/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.934313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.941362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abece419-3b33-4e19-8898-5eebe1b0a04c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.945015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13445-ed79-4a2c-8635-e3b2f5d4d8e7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.946798 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.947696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.948054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.948395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.949509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.951226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.952040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.953279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.953279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.953826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] PATH_INFO: `/v3/projects/1e0981e25e554d3685e382387b9bed98/users/7b4b07d05af44fc2a5a078680d4615c0/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.962737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 802/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:48.963823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:48.971856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0981e25e554d3685e382387b9bed98, user_id=7b4b07d05af44fc2a5a078680d4615c0, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:48.975628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:48.980924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291331-fae0-4103-ba26-9f9441529e13 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:48.987271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:48.988403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:48.988693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:48.988967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] PATH_INFO: `/v3/projects/bbf355bbc7b846f298928066e6b91b54/users/a330928e555a4f1ba17ab73d8c2f2914/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:48.996885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 798/1600] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:48 2022] PUT /identity/v3/projects/1e0981e25e554d3685e382387b9bed98/users/7b4b07d05af44fc2a5a078680d4615c0/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:48.996885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.013788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf355bbc7b846f298928066e6b91b54, user_id=a330928e555a4f1ba17ab73d8c2f2914, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.016669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.037656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 803/1601] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:48 2022] PUT /identity/v3/projects/bbf355bbc7b846f298928066e6b91b54/users/a330928e555a4f1ba17ab73d8c2f2914/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:49.037656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.074603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8626a1-eaec-4ff1-848f-7b81de515601 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.111841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d30be3-e32f-4f9d-bb60-a5eb5ca83e66 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.120137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.121066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.121655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.121987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] PATH_INFO: `/v3/projects/7785ca6defde4e40bf3e68557eb2290d/users/d8876e2cba404244b731450ff5112c99/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.142758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7785ca6defde4e40bf3e68557eb2290d, user_id=d8876e2cba404244b731450ff5112c99, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.145940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.147502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.148122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.148408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.148881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.150791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.152732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.164337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 804/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:49 2022] PUT /identity/v3/projects/7785ca6defde4e40bf3e68557eb2290d/users/d8876e2cba404244b731450ff5112c99/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:49.165511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.173267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 799/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:49.173267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.182600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebe310-72c7-49d0-bc67-1798be729896 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.246626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:49.263947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb294-9acd-4383-9bad-451147ccbe72 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.266027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47471aa8-3e0e-4157-bd4d-c993f359bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.267010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471aa8-3e0e-4157-bd4d-c993f359bb3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.267498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471aa8-3e0e-4157-bd4d-c993f359bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.267958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471aa8-3e0e-4157-bd4d-c993f359bb3f admin admin] PATH_INFO: `/v3/projects/f66527e68f744b299c3348525ddeb738/users/6f66486c3aea46c38779010778b0bfb0/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.269732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc991b1-7ec3-48c4-8a4d-bc4a5c22a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.270346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc991b1-7ec3-48c4-8a4d-bc4a5c22a7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.270625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc991b1-7ec3-48c4-8a4d-bc4a5c22a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.270894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc991b1-7ec3-48c4-8a4d-bc4a5c22a7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.271671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc991b1-7ec3-48c4-8a4d-bc4a5c22a7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.273718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc991b1-7ec3-48c4-8a4d-bc4a5c22a7f0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.286435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 805/1604] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:49.287927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017068-b33f-4132-86ee-ac28f57ed353 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.288209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017068-b33f-4132-86ee-ac28f57ed353 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.288482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3017068-b33f-4132-86ee-ac28f57ed353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.297081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47471aa8-3e0e-4157-bd4d-c993f359bb3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66527e68f744b299c3348525ddeb738, user_id=6f66486c3aea46c38779010778b0bfb0, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.302873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47471aa8-3e0e-4157-bd4d-c993f359bb3f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.309895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e3017068-b33f-4132-86ee-ac28f57ed353 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:49.311311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e3017068-b33f-4132-86ee-ac28f57ed353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:49.320034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 806/1605] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:49.324863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88829ff-8476-482e-b9da-7c154bcc5762 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.325218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88829ff-8476-482e-b9da-7c154bcc5762 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.325573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88829ff-8476-482e-b9da-7c154bcc5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.330627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 800/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:49 2022] PUT /identity/v3/projects/f66527e68f744b299c3348525ddeb738/users/6f66486c3aea46c38779010778b0bfb0/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:49.331996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc968a-9c02-404e-ba17-ab144651a939 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.332280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc968a-9c02-404e-ba17-ab144651a939 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.332549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc968a-9c02-404e-ba17-ab144651a939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.360815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d88829ff-8476-482e-b9da-7c154bcc5762 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:49.362100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d88829ff-8476-482e-b9da-7c154bcc5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:49.374755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-41dc968a-9c02-404e-ba17-ab144651a939 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:49.381916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-41dc968a-9c02-404e-ba17-ab144651a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:49.386981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:49.436715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 807/1607] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:49.437562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88829ff-8476-482e-b9da-7c154bcc5762 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.447215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88829ff-8476-482e-b9da-7c154bcc5762 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.457854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.459159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.459991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.460333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] PATH_INFO: `/v3/projects/ce1f07a9f26540a682edbd2ef7759cab/users/36cfdf71cf0b461894bb514c16032227/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.485273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1f07a9f26540a682edbd2ef7759cab, user_id=36cfdf71cf0b461894bb514c16032227, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.486211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 801/1608] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:49.487189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc968a-9c02-404e-ba17-ab144651a939 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.488252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.499417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc968a-9c02-404e-ba17-ab144651a939 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.510149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 808/1609] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:49 2022] PUT /identity/v3/projects/ce1f07a9f26540a682edbd2ef7759cab/users/36cfdf71cf0b461894bb514c16032227/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:49.511111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.604017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e238656-9b31-49f0-b470-510a71a2d1bc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.609183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.610094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.610440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.610772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.634308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ad953-a70c-4472-80a2-ab1316d56a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.635671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad953-a70c-4472-80a2-ab1316d56a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.636139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad953-a70c-4472-80a2-ab1316d56a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.636561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ad953-a70c-4472-80a2-ab1316d56a9e admin admin] PATH_INFO: `/v3/projects/5d196c1d59df4b258604eb5d3e34fc37/users/4598c720411a4e119d8625bf8c53f134/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.774959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ad953-a70c-4472-80a2-ab1316d56a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d196c1d59df4b258604eb5d3e34fc37, user_id=4598c720411a4e119d8625bf8c53f134, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.774959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ad953-a70c-4472-80a2-ab1316d56a9e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.774959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 802/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:49 2022] PUT /identity/v3/projects/5d196c1d59df4b258604eb5d3e34fc37/users/4598c720411a4e119d8625bf8c53f134/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:49.774959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aea75-68fd-435a-a6d2-c67bcc3da8c7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.774959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aea75-68fd-435a-a6d2-c67bcc3da8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.774959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aea75-68fd-435a-a6d2-c67bcc3da8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.775614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.775614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:49.775614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 809/1611] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:49.775614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.791928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f85c-13f9-4044-9664-2767b6d453de service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.814306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-710aea75-68fd-435a-a6d2-c67bcc3da8c7 None None] MFA Rules not processed for user `6f66486c3aea46c38779010778b0bfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:49.818225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-710aea75-68fd-435a-a6d2-c67bcc3da8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:49.876256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9553c5-5942-4223-9e71-20a8a3e0bb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.876987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9553c5-5942-4223-9e71-20a8a3e0bb28 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.877334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9553c5-5942-4223-9e71-20a8a3e0bb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.877783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9553c5-5942-4223-9e71-20a8a3e0bb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.883316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:49.903168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:49.953271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 803/1612] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:49.955081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aea75-68fd-435a-a6d2-c67bcc3da8c7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:49.970264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aea75-68fd-435a-a6d2-c67bcc3da8c7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:49.975794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3a8a4-8543-48dd-a2af-025ea2f219b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:49.976853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3a8a4-8543-48dd-a2af-025ea2f219b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:49.977355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3a8a4-8543-48dd-a2af-025ea2f219b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:49.977693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3a8a4-8543-48dd-a2af-025ea2f219b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:49.995051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9553c5-5942-4223-9e71-20a8a3e0bb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:49.996990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9553c5-5942-4223-9e71-20a8a3e0bb28 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.008559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 810/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:50.010078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d426-9242-4b21-935f-e14d70c7ec65 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.010358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d426-9242-4b21-935f-e14d70c7ec65 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.010627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5d426-9242-4b21-935f-e14d70c7ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.035713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a8a5d426-9242-4b21-935f-e14d70c7ec65 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:50.036845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8a5d426-9242-4b21-935f-e14d70c7ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:50.049445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 811/1614] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:50.051099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7806f-c2c0-4545-a94b-7d7a9416dd63 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.051382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7806f-c2c0-4545-a94b-7d7a9416dd63 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.051651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7806f-c2c0-4545-a94b-7d7a9416dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.081390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3a8a4-8543-48dd-a2af-025ea2f219b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.083583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3a8a4-8543-48dd-a2af-025ea2f219b5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.087366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d6f7806f-c2c0-4545-a94b-7d7a9416dd63 None None] MFA Rules not processed for user `4598c720411a4e119d8625bf8c53f134`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:50.090638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d6f7806f-c2c0-4545-a94b-7d7a9416dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:50.096912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 804/1615] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:50.097961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728625-d229-49fa-a28d-4dbc0017c631 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.098243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728625-d229-49fa-a28d-4dbc0017c631 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.098511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0728625-d229-49fa-a28d-4dbc0017c631 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.099828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 805/1616] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 30 00:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:36:50.101239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728625-d229-49fa-a28d-4dbc0017c631 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.118726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0728625-d229-49fa-a28d-4dbc0017c631 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.124542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06361359-3bb1-4b29-87eb-13a55ecd835c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.127993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06361359-3bb1-4b29-87eb-13a55ecd835c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.128277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06361359-3bb1-4b29-87eb-13a55ecd835c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.128601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06361359-3bb1-4b29-87eb-13a55ecd835c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.147941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06361359-3bb1-4b29-87eb-13a55ecd835c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.149452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06361359-3bb1-4b29-87eb-13a55ecd835c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.167257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 806/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:50.168604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bb58-1d21-4ed1-a79e-b1e9a89f96c7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.168940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bb58-1d21-4ed1-a79e-b1e9a89f96c7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.169218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7bb58-1d21-4ed1-a79e-b1e9a89f96c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.188348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 812/1618] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:50.193198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7806f-c2c0-4545-a94b-7d7a9416dd63 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.209216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7806f-c2c0-4545-a94b-7d7a9416dd63 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.215401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.216208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.216536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.216881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.217521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.221037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.234720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-72c7bb58-1d21-4ed1-a79e-b1e9a89f96c7 None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:50.236283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-72c7bb58-1d21-4ed1-a79e-b1e9a89f96c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:50.265763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 813/1619] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:50 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:50.268816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.348556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 807/1620] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 30 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:50.358003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7bb58-1d21-4ed1-a79e-b1e9a89f96c7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.398373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7bb58-1d21-4ed1-a79e-b1e9a89f96c7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.409722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658a73-3631-4727-b135-40d1d6f0ca3b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.424636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.425231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.425507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.425793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.430300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.432340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.452561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:50.483900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 814/1621] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:50 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:36:50.485839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:50.488156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.510801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0306aa8-39be-43ae-be28-928b9d614ef7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.521942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.522651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.523132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.524609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.527623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.529419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.530505 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.530970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.531421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.531916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.570575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 815/1622] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:36:50.572392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.599004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ec16d-90a9-4dfa-982c-34f8e0fbfe8b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.609166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.611721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.613308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.613752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] PATH_INFO: `/v3/projects/561ebe9a475d4eae97231f5973fd3095/users/07e4ebb04f6b44e68bfc0c4931b027ee/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.630008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.631965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.646134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 808/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:36:50.651658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=561ebe9a475d4eae97231f5973fd3095, user_id=07e4ebb04f6b44e68bfc0c4931b027ee, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.660699 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.687480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 816/1624] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:50 2022] PUT /identity/v3/projects/561ebe9a475d4eae97231f5973fd3095/users/07e4ebb04f6b44e68bfc0c4931b027ee/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:50.691989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.707076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5b5f2-1b79-49b9-a2e8-e0cc090f5125 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.831417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08353f8d-4380-4feb-a371-8e3d60a47c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.832484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353f8d-4380-4feb-a371-8e3d60a47c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.833037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353f8d-4380-4feb-a371-8e3d60a47c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.834295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353f8d-4380-4feb-a371-8e3d60a47c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.835263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08353f8d-4380-4feb-a371-8e3d60a47c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.838684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08353f8d-4380-4feb-a371-8e3d60a47c71 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.870855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 809/1625] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:50.874758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:50.896606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0c5f5-0941-482e-a272-cc25b0306efc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:50.918385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01950d8-78da-49c2-8e7e-24f97d2ce3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:50.919298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01950d8-78da-49c2-8e7e-24f97d2ce3da admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.919438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01950d8-78da-49c2-8e7e-24f97d2ce3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.919612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01950d8-78da-49c2-8e7e-24f97d2ce3da admin admin] PATH_INFO: `/v3/projects/561ebe9a475d4eae97231f5973fd3095/users/07e4ebb04f6b44e68bfc0c4931b027ee/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:50.923680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01950d8-78da-49c2-8e7e-24f97d2ce3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=561ebe9a475d4eae97231f5973fd3095, user_id=07e4ebb04f6b44e68bfc0c4931b027ee, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:50.926378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01950d8-78da-49c2-8e7e-24f97d2ce3da admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:50.959275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 817/1626] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:50 2022] PUT /identity/v3/projects/561ebe9a475d4eae97231f5973fd3095/users/07e4ebb04f6b44e68bfc0c4931b027ee/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:36:50.969461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694cf8e-7111-4706-b7c8-06abad714115 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:50.969819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694cf8e-7111-4706-b7c8-06abad714115 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:50.970096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694cf8e-7111-4706-b7c8-06abad714115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.030637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9694cf8e-7111-4706-b7c8-06abad714115 None None] MFA Rules not processed for user `07e4ebb04f6b44e68bfc0c4931b027ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:51.031981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9694cf8e-7111-4706-b7c8-06abad714115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:51.113910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88723d3a-6ea6-4010-9463-907d50da93bf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.114198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88723d3a-6ea6-4010-9463-907d50da93bf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.114480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88723d3a-6ea6-4010-9463-907d50da93bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.173218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-88723d3a-6ea6-4010-9463-907d50da93bf None None] MFA Rules not processed for user `a538539e3a5e423e9c84cef3f8bede2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:51.174498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88723d3a-6ea6-4010-9463-907d50da93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:51.241167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:51.252613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 810/1627] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:51.254976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436a0a0-8d2f-477b-a059-326d1abe526e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.255857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436a0a0-8d2f-477b-a059-326d1abe526e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.256445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436a0a0-8d2f-477b-a059-326d1abe526e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.258404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 811/1628] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 30 00:36:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:36:51.261087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436a0a0-8d2f-477b-a059-326d1abe526e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:51.319800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 818/1629] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:36:51.326602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e089-53cf-4e8d-ba5f-0b33e512b1fb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.328351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e089-53cf-4e8d-ba5f-0b33e512b1fb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.328662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e089-53cf-4e8d-ba5f-0b33e512b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.373440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9cc8e089-53cf-4e8d-ba5f-0b33e512b1fb None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:51.375737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9cc8e089-53cf-4e8d-ba5f-0b33e512b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:51.414448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436a0a0-8d2f-477b-a059-326d1abe526e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:51.418700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:51.419334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.419612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.419884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.440335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:51.442024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:51.470028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 812/1630] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:51.470995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:51.599615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e036b72-37c9-422e-a20c-6676f1c2c4d9 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:51.608974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:51.609626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.609910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.610182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.610827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:51.613857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:51.641099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 819/1631] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:36:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:51.645374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e089-53cf-4e8d-ba5f-0b33e512b1fb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:51.678991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 813/1632] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:36:51 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:51.679562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e089-53cf-4e8d-ba5f-0b33e512b1fb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:51.680829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:51.767375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:51.820908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1862208-cd7a-4530-b55d-e1006515e175 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:51.838878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:51.839520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.839796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.840081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.840711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:51.842852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:51.861498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:51.862068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.862341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.862608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.900151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 814/1633] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:36:51 2022] POST /identity/v3/users => generated 309 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:36:51.901203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:51.920428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ea972-8e54-4093-afd3-8be8e8908b15 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:51.932413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:51.933095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:51.933379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:51.933679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:51.962281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:52.050570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:52.054324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:52.068293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:52.069798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:52.093510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 815/1634] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:52.095485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:52.119530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748f3f-3516-42ba-828d-b6c8258cd5f4 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:52.120641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 820/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:36:52.131802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:52.132440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:52.132795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:52.133036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:52.133761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:52.135460 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:52.156661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 816/1636] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:52.160984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:52.177832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afe83e-8633-4ea9-9915-eb3a9954e867 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:52.207774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:52.208498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:52.208930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:52.209049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] PATH_INFO: `/v3/projects/eff13cdb031944d2a663b73af80d9003/users/87414f76413142e9a9336b5fa13647a3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:52.263489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff13cdb031944d2a663b73af80d9003, user_id=87414f76413142e9a9336b5fa13647a3, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:52.266251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:52.293180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:52.293535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 821/1637] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:52 2022] PUT /identity/v3/projects/eff13cdb031944d2a663b73af80d9003/users/87414f76413142e9a9336b5fa13647a3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:52.303617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7724b8-c23f-4e07-8d7e-b642fb5fcc6f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:52.451795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fe2d5-45e6-46fc-99b1-2373b31b9188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:52.452431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe2d5-45e6-46fc-99b1-2373b31b9188 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:52.452714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe2d5-45e6-46fc-99b1-2373b31b9188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:52.452986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe2d5-45e6-46fc-99b1-2373b31b9188 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:52.453680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fe2d5-45e6-46fc-99b1-2373b31b9188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:52.456230 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fe2d5-45e6-46fc-99b1-2373b31b9188 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:52.488119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:52.490186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 817/1638] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:36:52.500150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6ae02-5c3e-4e26-918c-56225c74e9d2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:52.514521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a9694-3b0d-4be8-9292-4268650e3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:52.515567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a9694-3b0d-4be8-9292-4268650e3048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:52.516554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a9694-3b0d-4be8-9292-4268650e3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:52.517090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a9694-3b0d-4be8-9292-4268650e3048 admin admin] PATH_INFO: `/v3/projects/eff13cdb031944d2a663b73af80d9003/users/87414f76413142e9a9336b5fa13647a3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:52.519742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a9694-3b0d-4be8-9292-4268650e3048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff13cdb031944d2a663b73af80d9003, user_id=87414f76413142e9a9336b5fa13647a3, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:52.524316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a9694-3b0d-4be8-9292-4268650e3048 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:52.540456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 822/1639] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:36:52 2022] PUT /identity/v3/projects/eff13cdb031944d2a663b73af80d9003/users/87414f76413142e9a9336b5fa13647a3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:53.784796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f36de-a709-43a3-a194-c121ddd8712a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:53.785272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f36de-a709-43a3-a194-c121ddd8712a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:53.785579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f36de-a709-43a3-a194-c121ddd8712a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:53.787571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 818/1640] 10.222.0.42 () {54 vars in 962 bytes} [Tue Aug 30 00:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:36:53.804866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db327b4-cbb7-4604-94c5-5b82998bbb8e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:53.805830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db327b4-cbb7-4604-94c5-5b82998bbb8e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:53.807041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db327b4-cbb7-4604-94c5-5b82998bbb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:53.843724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1db327b4-cbb7-4604-94c5-5b82998bbb8e None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:53.844712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1db327b4-cbb7-4604-94c5-5b82998bbb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:54.014682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 823/1641] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Aug 30 00:36:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:54.016083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cadee7-c4fe-444f-b140-19694b008080 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:54.016478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cadee7-c4fe-444f-b140-19694b008080 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:54.016803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cadee7-c4fe-444f-b140-19694b008080 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:54.018858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 819/1642] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 30 00:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:36:54.024047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08714b9-7f60-4766-b299-cebc24dac91a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:54.024326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08714b9-7f60-4766-b299-cebc24dac91a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:54.024595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08714b9-7f60-4766-b299-cebc24dac91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:54.058127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c08714b9-7f60-4766-b299-cebc24dac91a None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:54.059738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c08714b9-7f60-4766-b299-cebc24dac91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:54.079201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 824/1643] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:36:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:54.098727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cadee7-c4fe-444f-b140-19694b008080 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:54.190975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cadee7-c4fe-444f-b140-19694b008080 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:54.195775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d30e3c-2cd3-4ffd-b7b8-16ac9e2a0951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:54.196492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30e3c-2cd3-4ffd-b7b8-16ac9e2a0951 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:54.196818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30e3c-2cd3-4ffd-b7b8-16ac9e2a0951 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:54.197392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30e3c-2cd3-4ffd-b7b8-16ac9e2a0951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:54.213875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30e3c-2cd3-4ffd-b7b8-16ac9e2a0951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:54.215510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30e3c-2cd3-4ffd-b7b8-16ac9e2a0951 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:54.243115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 820/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:56.831294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e6360-5816-4501-b6cf-869fe3b49b50 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:56.832687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e6360-5816-4501-b6cf-869fe3b49b50 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:56.833123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e6360-5816-4501-b6cf-869fe3b49b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:56.872637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:56.879639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e65e6360-5816-4501-b6cf-869fe3b49b50 None None] MFA Rules not processed for user `87414f76413142e9a9336b5fa13647a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:56.880891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e65e6360-5816-4501-b6cf-869fe3b49b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:57.035166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 825/1645] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:58.578027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06fc5d-9ad5-4d4a-8894-24956358d5a1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:58.579897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06fc5d-9ad5-4d4a-8894-24956358d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:58.580910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06fc5d-9ad5-4d4a-8894-24956358d5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:58.683161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2d06fc5d-9ad5-4d4a-8894-24956358d5a1 None None] MFA Rules not processed for user `2532defc863d4fbe8885c6f38169b5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:36:58.684410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2d06fc5d-9ad5-4d4a-8894-24956358d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:36:58.803252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:36:58.919816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 821/1646] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:36:58.933016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e6360-5816-4501-b6cf-869fe3b49b50 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:58.977319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e6360-5816-4501-b6cf-869fe3b49b50 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:58.998715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c385a9-af88-4b73-acf9-a26763dd80de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:58.999633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c385a9-af88-4b73-acf9-a26763dd80de service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:59.000227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c385a9-af88-4b73-acf9-a26763dd80de service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:59.000663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c385a9-af88-4b73-acf9-a26763dd80de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:59.013454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c385a9-af88-4b73-acf9-a26763dd80de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:59.019135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c385a9-af88-4b73-acf9-a26763dd80de service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:59.036897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 826/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:36:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:36:59.395074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06fc5d-9ad5-4d4a-8894-24956358d5a1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:36:59.620175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06fc5d-9ad5-4d4a-8894-24956358d5a1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:36:59.632796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:36:59.634137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:59.634617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:59.635875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] PATH_INFO: `/v3/users/6f66486c3aea46c38779010778b0bfb0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:36:59.638545 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f66486c3aea46c38779010778b0bfb0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:36:59.640547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:36:59.640547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: warnings.warn(msg) Aug 30 00:36:59.640547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: Aug 30 00:36:59.644790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:36:59.844500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f66486c3aea46c38779010778b0bfb0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:36:59.845776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f66486c3aea46c38779010778b0bfb0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:36:59.887030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f66486c3aea46c38779010778b0bfb0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:36:59.909409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f66486c3aea46c38779010778b0bfb0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:36:59.910217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f66486c3aea46c38779010778b0bfb0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:36:59.974454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 822/1648] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:36:59 2022] DELETE /identity/v3/users/6f66486c3aea46c38779010778b0bfb0 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:36:59.979392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:36:59.979893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:36:59.979996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:00.012615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:00.014120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:00.099762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 827/1649] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:00.137472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:00.139041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:00.299472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e422c8-d433-4b21-a59b-62ab99abde1a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:00.311996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4e25-5673-4729-a244-e82966eaf496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:00.312697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4e25-5673-4729-a244-e82966eaf496 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:00.312984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4e25-5673-4729-a244-e82966eaf496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:00.313254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4e25-5673-4729-a244-e82966eaf496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:00.331405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:00.336077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4e25-5673-4729-a244-e82966eaf496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:00.339252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4e25-5673-4729-a244-e82966eaf496 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:00.369902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 823/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:00.975039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:00.976668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:00.997359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bb90c-aede-46e8-b3c6-8878e975fdd1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:01.006886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:01.007574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:01.007843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:01.008111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] PATH_INFO: `/v3/users/4598c720411a4e119d8625bf8c53f134` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:01.012256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4598c720411a4e119d8625bf8c53f134)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:01.014388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:01.150786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4598c720411a4e119d8625bf8c53f134'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:01.185380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4598c720411a4e119d8625bf8c53f134'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:01.202569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4598c720411a4e119d8625bf8c53f134'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:01.204467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4598c720411a4e119d8625bf8c53f134'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:01.206217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4598c720411a4e119d8625bf8c53f134'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:01.234081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:01.251683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 828/1651] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:00 2022] DELETE /identity/v3/users/4598c720411a4e119d8625bf8c53f134 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:01.256633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6696d69-235c-475d-95a1-0337464b07bc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:01.257138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6696d69-235c-475d-95a1-0337464b07bc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:01.257379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6696d69-235c-475d-95a1-0337464b07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:01.294505 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d6696d69-235c-475d-95a1-0337464b07bc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:01.296275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d6696d69-235c-475d-95a1-0337464b07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:01.485280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 824/1652] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:01.546512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:01.548310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:01.636979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323662da-40f3-489e-8143-248bc0802172 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:01.637271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323662da-40f3-489e-8143-248bc0802172 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:01.637560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323662da-40f3-489e-8143-248bc0802172 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:01.639661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 825/1653] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:37:01.676612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678ebbe-5bd5-479f-a4bf-0dee67f61933 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:01.684201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:01.684833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:01.686543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:01.686993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:01.698014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:01.701533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:01.716907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 829/1654] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:01.775947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:01.776484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:01.777078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:01.816207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:01.818359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:02.006928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 826/1655] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:37:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:02.203399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:02.205006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:02.232451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d5799-d543-4a1c-91a7-c985f2a65356 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:02.246369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:02.247015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:02.247297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:02.247572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:02.261819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:02.263846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:02.286518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 830/1656] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:03.661713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:03.663185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:03.687315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a126ee-0840-484a-9f45-894e192093c6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:03.698448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:03.699115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:03.699396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:03.699666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] PATH_INFO: `/v3/projects/5d196c1d59df4b258604eb5d3e34fc37` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:03.710514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d196c1d59df4b258604eb5d3e34fc37)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:03.712686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:03.805447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d196c1d59df4b258604eb5d3e34fc37', 'request_id': 'req-0e634648-4207-4568-a2c8-6c61bc492017'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:03.824203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d196c1d59df4b258604eb5d3e34fc37', 'request_id': 'req-0e634648-4207-4568-a2c8-6c61bc492017'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:03.832409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d196c1d59df4b258604eb5d3e34fc37', 'request_id': 'req-0e634648-4207-4568-a2c8-6c61bc492017'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:03.856162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] The token cache is being invalidate because project 5d196c1d59df4b258604eb5d3e34fc37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:03.856446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:03.857108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:03.858959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 827/1657] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:03 2022] DELETE /identity/v3/projects/5d196c1d59df4b258604eb5d3e34fc37 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:03.862905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:03.882631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd5c5-448a-480b-bc9a-31244eabe885 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:04.085046 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:04.086974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:04.087518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:04.088034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] PATH_INFO: `/v3/users/07e4ebb04f6b44e68bfc0c4931b027ee` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:04.092447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e4ebb04f6b44e68bfc0c4931b027ee)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:04.102360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:04.213648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e4ebb04f6b44e68bfc0c4931b027ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.257626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e4ebb04f6b44e68bfc0c4931b027ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.269073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e4ebb04f6b44e68bfc0c4931b027ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.269886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e4ebb04f6b44e68bfc0c4931b027ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.270508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-68591e2b-56ea-4525-b5e9-4774cd973ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e4ebb04f6b44e68bfc0c4931b027ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.296112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 831/1658] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:03 2022] DELETE /identity/v3/users/07e4ebb04f6b44e68bfc0c4931b027ee => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:04.507789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:04.509261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:04.536912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634648-4207-4568-a2c8-6c61bc492017 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:04.570936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:04.678203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:04.679702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:04.680287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:04.680855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] PATH_INFO: `/v3/projects/f66527e68f744b299c3348525ddeb738` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:04.683318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66527e68f744b299c3348525ddeb738)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:04.686368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:04.763153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66527e68f744b299c3348525ddeb738', 'request_id': 'req-e925718d-6b49-46d1-8e63-06ab21a904d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.771339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66527e68f744b299c3348525ddeb738', 'request_id': 'req-e925718d-6b49-46d1-8e63-06ab21a904d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.786981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66527e68f744b299c3348525ddeb738', 'request_id': 'req-e925718d-6b49-46d1-8e63-06ab21a904d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.803512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] The token cache is being invalidate because project f66527e68f744b299c3348525ddeb738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:04.804167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.805017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e925718d-6b49-46d1-8e63-06ab21a904d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:04.810048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 828/1659] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:04 2022] DELETE /identity/v3/projects/f66527e68f744b299c3348525ddeb738 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:04.813147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b854-cd47-4f42-bf44-611e19cad4dc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:04.813945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b854-cd47-4f42-bf44-611e19cad4dc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:04.816333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b854-cd47-4f42-bf44-611e19cad4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:04.831180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668ad9-dd2e-4b83-8079-4d67880305a7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:04.831853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668ad9-dd2e-4b83-8079-4d67880305a7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:04.832492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e668ad9-dd2e-4b83-8079-4d67880305a7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:04.834801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 829/1660] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:37:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:37:04.838995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:04.856227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4f70b854-cd47-4f42-bf44-611e19cad4dc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:04.860754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4f70b854-cd47-4f42-bf44-611e19cad4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:05.011309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9577be-6394-4bbf-8317-bdc7a58c37f7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.011933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9577be-6394-4bbf-8317-bdc7a58c37f7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.012834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9577be-6394-4bbf-8317-bdc7a58c37f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.034617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 832/1661] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:05.036339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd521-1395-4756-8777-c7502cc5c808 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.037281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd521-1395-4756-8777-c7502cc5c808 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.037281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd521-1395-4756-8777-c7502cc5c808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.070610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-be9577be-6394-4bbf-8317-bdc7a58c37f7 None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:05.072415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8b1fd521-1395-4756-8777-c7502cc5c808 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:05.073249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-be9577be-6394-4bbf-8317-bdc7a58c37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:05.073661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8b1fd521-1395-4756-8777-c7502cc5c808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:05.092351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 833/1662] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:05.096640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd521-1395-4756-8777-c7502cc5c808 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.117892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd521-1395-4756-8777-c7502cc5c808 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.141915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.142558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.142835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.143105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.143766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:05.144067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.145712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:05.177369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 834/1663] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:05.178312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.180721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:05.216059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5dd6c-daae-4fcc-9e2d-73553eb7ce9b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.230256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.230547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.230828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.231099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] PATH_INFO: `/v3/users/a538539e3a5e423e9c84cef3f8bede2f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.233100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 830/1664] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:37:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:05.234152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9577be-6394-4bbf-8317-bdc7a58c37f7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.237406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a538539e3a5e423e9c84cef3f8bede2f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.239409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:05.269896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9577be-6394-4bbf-8317-bdc7a58c37f7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.279455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.280959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.281349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.281759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.282503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.284560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:05.366195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a538539e3a5e423e9c84cef3f8bede2f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:05.368054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 831/1665] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:05 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:05.368862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.370730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:05.403906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a538539e3a5e423e9c84cef3f8bede2f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:05.414865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:05.423699 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a538539e3a5e423e9c84cef3f8bede2f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:05.426043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a538539e3a5e423e9c84cef3f8bede2f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:05.426939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a538539e3a5e423e9c84cef3f8bede2f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:05.458295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 835/1666] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:05 2022] DELETE /identity/v3/users/a538539e3a5e423e9c84cef3f8bede2f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:05.459159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.465389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:05.566691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd87362-797b-493f-b1a2-8203da35e421 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.654999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b829e96-1597-4081-9166-7192116ba453 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.670189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.670779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.671058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.677008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.677909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.693411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:05.712946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:05.742520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.743169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.743610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.744112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.756113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:05.758384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 836/1667] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:05 2022] POST /identity/v3/users => generated 302 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:05.763285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.798397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c499a-e943-46d1-bc4c-6e299f9c9234 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.813506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.813619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:05.815186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.816120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.818203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.818631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.819415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.823602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:05.838880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 832/1668] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:05.850636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 837/1669] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:05.854820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.869444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff82f6-b190-45dd-aeed-204590b3b0f8 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.882637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d83c7a-1e12-4fe2-93aa-3df1e2487e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.883432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d83c7a-1e12-4fe2-93aa-3df1e2487e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.884015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d83c7a-1e12-4fe2-93aa-3df1e2487e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.884425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d83c7a-1e12-4fe2-93aa-3df1e2487e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.885254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d83c7a-1e12-4fe2-93aa-3df1e2487e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.887108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d83c7a-1e12-4fe2-93aa-3df1e2487e92 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:05.899568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 833/1670] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:05.904069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:05.924953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48278e-e5e6-4b89-9fc2-6af3b946dffa admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:05.942643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d189b9c-6fad-47f4-919e-162b8bd00b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:05.943747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189b9c-6fad-47f4-919e-162b8bd00b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:05.943747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189b9c-6fad-47f4-919e-162b8bd00b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:05.944162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189b9c-6fad-47f4-919e-162b8bd00b9c admin admin] PATH_INFO: `/v3/projects/fe27178cd9474c6ca23bff4d7139d5fe/users/2d9d682b9c1c4441a2be3b0742c7b00e/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:05.983298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d189b9c-6fad-47f4-919e-162b8bd00b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe27178cd9474c6ca23bff4d7139d5fe, user_id=2d9d682b9c1c4441a2be3b0742c7b00e, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:05.986266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d189b9c-6fad-47f4-919e-162b8bd00b9c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:06.019179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 838/1671] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:05 2022] PUT /identity/v3/projects/fe27178cd9474c6ca23bff4d7139d5fe/users/2d9d682b9c1c4441a2be3b0742c7b00e/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:06.035276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a56c7-c66f-4606-92eb-996262f547e1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:06.036038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a56c7-c66f-4606-92eb-996262f547e1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:06.036409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a56c7-c66f-4606-92eb-996262f547e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:06.050989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:06.051609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:06.051895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:06.135890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] MFA Rules not processed for user `d8876e2cba404244b731450ff5112c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:06.139048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f36a56c7-c66f-4606-92eb-996262f547e1 None None] MFA Rules not processed for user `2d9d682b9c1c4441a2be3b0742c7b00e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:06.140340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f36a56c7-c66f-4606-92eb-996262f547e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:06.142824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:06.337917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 834/1672] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:06.340914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a56c7-c66f-4606-92eb-996262f547e1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:06.343151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 839/1673] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:06.357367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:06.361302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:06.458514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:06.529451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a56c7-c66f-4606-92eb-996262f547e1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:06.558466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:06.560675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:06.561109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:06.561515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:06.587144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:06.598333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:06.640342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc3db0-48a3-430b-8060-6ec3b72cd66b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:06.656946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 835/1674] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:06 2022] POST /identity/v3/projects => generated 403 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:06.661898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:06.662782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:06.663066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:06.664728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:06.665187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:06.696198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:06.697896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:06.737757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 840/1675] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:37:06.828735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5722-4b06-45e3-afe7-230238bc31ca admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:06.846300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:06.846791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:06.847059 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:06.847324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:06.848364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:06.852920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:06.948785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 836/1676] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:06 2022] POST /identity/v3/users => generated 308 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:06.953292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:06.970375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d0a01-f103-4537-985a-83551d752b45 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:06.980594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:06.981302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:06.981668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:06.981878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:06.984759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:06.989651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:07.021852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 841/1677] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:07.021984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:07.044458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83e863-c452-4446-a2b6-89ca7aa1663f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:07.075586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:07.076282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:07.076558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:07.077443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] PATH_INFO: `/v3/projects/3afb6d81c2d54e0092632052cfb60099/users/8e6738f9ae0742128a4847536ff1c98e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:07.097578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afb6d81c2d54e0092632052cfb60099, user_id=8e6738f9ae0742128a4847536ff1c98e, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:07.099961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:07.124877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 837/1678] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:07 2022] PUT /identity/v3/projects/3afb6d81c2d54e0092632052cfb60099/users/8e6738f9ae0742128a4847536ff1c98e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:07.126272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:07.137774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92098-8b8e-4c5a-99e3-536f06a3066a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:07.153289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:07.196324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:07.198374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:07.257456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:07.258401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:07.258909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:07.259373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:07.260904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:07.264730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:07.301499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 842/1679] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:07.307375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:07.334009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f877f7b-eb95-49d6-87e6-857fd95f51f0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:07.347586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad9f48-8552-4ffe-bf72-cc9ffb22495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:07.349134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9f48-8552-4ffe-bf72-cc9ffb22495b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:07.351139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9f48-8552-4ffe-bf72-cc9ffb22495b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:07.351139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9f48-8552-4ffe-bf72-cc9ffb22495b admin admin] PATH_INFO: `/v3/projects/3afb6d81c2d54e0092632052cfb60099/users/8e6738f9ae0742128a4847536ff1c98e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:07.355313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad9f48-8552-4ffe-bf72-cc9ffb22495b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afb6d81c2d54e0092632052cfb60099, user_id=8e6738f9ae0742128a4847536ff1c98e, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:07.362500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad9f48-8552-4ffe-bf72-cc9ffb22495b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:07.374497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbdf18-e1a5-4c99-8235-9ce1281fd97d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:07.386431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 843/1680] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:07 2022] PUT /identity/v3/projects/3afb6d81c2d54e0092632052cfb60099/users/8e6738f9ae0742128a4847536ff1c98e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:07.399897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb460f-d20a-42ce-9ad7-c05bc10a0adb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:07.400228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb460f-d20a-42ce-9ad7-c05bc10a0adb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:07.400499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb460f-d20a-42ce-9ad7-c05bc10a0adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:07.463909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:07.486877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b9cb460f-d20a-42ce-9ad7-c05bc10a0adb None None] MFA Rules not processed for user `8e6738f9ae0742128a4847536ff1c98e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:07.490467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9cb460f-d20a-42ce-9ad7-c05bc10a0adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:07.548206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:07.550062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:07.550679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:07.550956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] PATH_INFO: `/v3/projects/b6d0f3796564460eb3efeb39cf10b0c8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:07.555032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d0f3796564460eb3efeb39cf10b0c8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:07.564827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:07.685710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d0f3796564460eb3efeb39cf10b0c8', 'request_id': 'req-7cd69c42-74ac-44a5-908d-481ef972ba31'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:07.688163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 844/1681] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:07 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:07.689295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:07.689599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:07.689874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:07.696645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d0f3796564460eb3efeb39cf10b0c8', 'request_id': 'req-7cd69c42-74ac-44a5-908d-481ef972ba31'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:07.709730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d0f3796564460eb3efeb39cf10b0c8', 'request_id': 'req-7cd69c42-74ac-44a5-908d-481ef972ba31'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:07.727835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] The token cache is being invalidate because project b6d0f3796564460eb3efeb39cf10b0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:07.728125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:07.730291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:07.731267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] MFA Rules not processed for user `a330928e555a4f1ba17ab73d8c2f2914`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:07.732519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:07.736737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 838/1682] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:07 2022] DELETE /identity/v3/projects/b6d0f3796564460eb3efeb39cf10b0c8 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:07.737800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:07.739228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:07.878151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69c42-74ac-44a5-908d-481ef972ba31 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:07.884837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 845/1683] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:07.892148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:07.893095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:07.893095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:07.893356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] PATH_INFO: `/v3/projects/561ebe9a475d4eae97231f5973fd3095` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:07.893902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:07.894607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=561ebe9a475d4eae97231f5973fd3095)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:07.895254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:07.896541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:07.921779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:08.031584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561ebe9a475d4eae97231f5973fd3095', 'request_id': 'req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.036002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f877-611e-4290-b2ba-6c9991371d43 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:08.054710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561ebe9a475d4eae97231f5973fd3095', 'request_id': 'req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.060339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:08.079873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561ebe9a475d4eae97231f5973fd3095', 'request_id': 'req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.100154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] The token cache is being invalidate because project 561ebe9a475d4eae97231f5973fd3095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:08.100575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.104183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.109333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 839/1684] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:07 2022] DELETE /identity/v3/projects/561ebe9a475d4eae97231f5973fd3095 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:08.109333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:08.109333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:08.171250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:08.172628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:08.173038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:08.173639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:08.176212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:08.271362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:08.273773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:08.297326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e01f1-b942-4b6c-86f6-4af6f822bb1f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:08.312872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 846/1685] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:07 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:08.315919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:08.320999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:08.324752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:08.325640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:08.327282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:08.327704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] PATH_INFO: `/v3/users/87414f76413142e9a9336b5fa13647a3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:08.329276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87414f76413142e9a9336b5fa13647a3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:08.331442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:08.485863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87414f76413142e9a9336b5fa13647a3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.487819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87414f76413142e9a9336b5fa13647a3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.500924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87414f76413142e9a9336b5fa13647a3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.516410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87414f76413142e9a9336b5fa13647a3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.520418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6027d98e-4213-4c88-9213-66c74930ae6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87414f76413142e9a9336b5fa13647a3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:08.563274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 840/1686] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:08 2022] DELETE /identity/v3/users/87414f76413142e9a9336b5fa13647a3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:08.565711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aff6d-aa5d-4c27-b075-b9960735506b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:08.566425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aff6d-aa5d-4c27-b075-b9960735506b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:08.567041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aff6d-aa5d-4c27-b075-b9960735506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:08.580052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960b5a7-2d92-4f64-96d5-473df38c6af6 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:08.598776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-076aff6d-aa5d-4c27-b075-b9960735506b None None] MFA Rules not processed for user `2532defc863d4fbe8885c6f38169b5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:08.601746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-076aff6d-aa5d-4c27-b075-b9960735506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:08.672941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:08.704482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 841/1687] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:08.705941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:08.706627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:08.707409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:08.742391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:08.743904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:08.757891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:08.866957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 842/1688] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:08.869643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:08.872107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:08.892647 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1e45-de46-4a3c-adf5-08a970993b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:08.893732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1e45-de46-4a3c-adf5-08a970993b42 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:08.899656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd77ac-aaed-4480-9803-1efc11e2e10a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:08.900372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1e45-de46-4a3c-adf5-08a970993b42 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:08.902017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1e45-de46-4a3c-adf5-08a970993b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:08.909039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e3cd1e45-de46-4a3c-adf5-08a970993b42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:08.910579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:08.911451 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:08.911735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:08.912013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] PATH_INFO: `/v3/users/2d9d682b9c1c4441a2be3b0742c7b00e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:08.916531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9d682b9c1c4441a2be3b0742c7b00e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:08.922409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.073822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9d682b9c1c4441a2be3b0742c7b00e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:09.075890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9d682b9c1c4441a2be3b0742c7b00e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:09.103943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9d682b9c1c4441a2be3b0742c7b00e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:09.126543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1e45-de46-4a3c-adf5-08a970993b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:09.130807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9d682b9c1c4441a2be3b0742c7b00e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:09.131412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ff4e2c4a-cfcd-4490-b577-5ea77c526a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9d682b9c1c4441a2be3b0742c7b00e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:09.133294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1e45-de46-4a3c-adf5-08a970993b42 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.171354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 847/1689] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:09.180341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9aa84-08ab-4545-9a2a-7bfd470edcd9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.180627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9aa84-08ab-4545-9a2a-7bfd470edcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.180897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9aa84-08ab-4545-9a2a-7bfd470edcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.210614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 843/1690] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:08 2022] DELETE /identity/v3/users/2d9d682b9c1c4441a2be3b0742c7b00e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:09.218002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8c628-0065-43ab-b153-c533fe0c66d6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.218285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8c628-0065-43ab-b153-c533fe0c66d6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.218560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8c628-0065-43ab-b153-c533fe0c66d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.247995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-08e9aa84-08ab-4545-9a2a-7bfd470edcd9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:09.258172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-08e9aa84-08ab-4545-9a2a-7bfd470edcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:09.272310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2ef8c628-0065-43ab-b153-c533fe0c66d6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:09.277537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ef8c628-0065-43ab-b153-c533fe0c66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:09.420514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 848/1691] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:09.421524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9aa84-08ab-4545-9a2a-7bfd470edcd9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:09.431158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 844/1692] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:09.443348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9aa84-08ab-4545-9a2a-7bfd470edcd9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:09.457635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:09.458551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.458895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.459231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.460102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:09.466157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:09.467796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.493651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 849/1693] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:09.498928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8c628-0065-43ab-b153-c533fe0c66d6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:09.518319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8c628-0065-43ab-b153-c533fe0c66d6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:09.528657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:09.529534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.530121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.531046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.532646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:09.538790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.619829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 845/1694] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:09 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:09.623194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:09.652151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049bbd-dc74-4265-ae9d-839f4d883121 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:09.655338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:09.658262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:09.670863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:09.774394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:09.798276 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:09.799282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.799737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.800178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.801055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:09.803709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.821080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b2aaf-6290-4907-9454-e44dbd1c2c7a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:09.830943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:09.831574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.831848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.832118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.839241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 850/1695] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:09 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:09.842910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:09.858583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:09.860618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.869021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6586c7-303d-4aa2-81e1-6f978ec71fe2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:09.878933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 846/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:09.882896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:09.883741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.884852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.885760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.887371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:09.893031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.926957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:09.928442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 851/1697] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:09.929236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:09.932583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:09.958138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4f664-5606-40ef-95e4-514d8d46a93f service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:09.975005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69395264-7a30-41c3-a1f7-a1e832da1fdf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:09.975144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:09.975518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.975907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.976152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] PATH_INFO: `/v3/projects/eff13cdb031944d2a663b73af80d9003` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:09.984473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff13cdb031944d2a663b73af80d9003)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:09.986186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd4be-41ea-423f-9a14-d60aac46b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:09.986756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:09.988529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd4be-41ea-423f-9a14-d60aac46b8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:09.988997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd4be-41ea-423f-9a14-d60aac46b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:09.989441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd4be-41ea-423f-9a14-d60aac46b8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.004053 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd4be-41ea-423f-9a14-d60aac46b8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:10.006363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd4be-41ea-423f-9a14-d60aac46b8d0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:10.055198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 852/1698] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:10.057244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c474d-4597-479c-869e-c9adf609630a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.057723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c474d-4597-479c-869e-c9adf609630a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.058126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c474d-4597-479c-869e-c9adf609630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.104560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff13cdb031944d2a663b73af80d9003', 'request_id': 'req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:10.119121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff13cdb031944d2a663b73af80d9003', 'request_id': 'req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:10.130072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff13cdb031944d2a663b73af80d9003', 'request_id': 'req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:10.130576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d21c474d-4597-479c-869e-c9adf609630a None None] MFA Rules not processed for user `7b4b07d05af44fc2a5a078680d4615c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:10.132319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d21c474d-4597-479c-869e-c9adf609630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:10.156299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] The token cache is being invalidate because project eff13cdb031944d2a663b73af80d9003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:10.156600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:10.157690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:10.162122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 847/1699] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:09 2022] DELETE /identity/v3/projects/eff13cdb031944d2a663b73af80d9003 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:10.162977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:10.169980 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:10.258014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 853/1700] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:10.265706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308f7a6-3114-4c1a-b2f9-1db92345293f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.265989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308f7a6-3114-4c1a-b2f9-1db92345293f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.266256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308f7a6-3114-4c1a-b2f9-1db92345293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.289163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a308f7a6-3114-4c1a-b2f9-1db92345293f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:10.291436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a308f7a6-3114-4c1a-b2f9-1db92345293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:10.293198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d20f5-f58f-40d8-83d0-0bd83d5d1ff9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:10.300154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:10.301191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.302631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.302967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] PATH_INFO: `/v3/projects/4036422be6b740b8af16d865c6350cdd/users/646f28da49304c61bd6dc90164eb4dbe/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.310114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 854/1701] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:10.311722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b13d7-d6e3-4ad8-b366-01eb5fce82fd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.312139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b13d7-d6e3-4ad8-b366-01eb5fce82fd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.312434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b13d7-d6e3-4ad8-b366-01eb5fce82fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.333772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c79b13d7-d6e3-4ad8-b366-01eb5fce82fd None None] MFA Rules not processed for user `7b4b07d05af44fc2a5a078680d4615c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:10.335217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c79b13d7-d6e3-4ad8-b366-01eb5fce82fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:10.343457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4036422be6b740b8af16d865c6350cdd, user_id=646f28da49304c61bd6dc90164eb4dbe, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:10.348006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 855/1702] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:10.348006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1c28-f3cb-4d8f-86c6-ebdff2256fdf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.348006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1c28-f3cb-4d8f-86c6-ebdff2256fdf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.348006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b1c28-f3cb-4d8f-86c6-ebdff2256fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.348379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:10.381305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f10b1c28-f3cb-4d8f-86c6-ebdff2256fdf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:10.382715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f10b1c28-f3cb-4d8f-86c6-ebdff2256fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:10.395804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 848/1703] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:10 2022] PUT /identity/v3/projects/4036422be6b740b8af16d865c6350cdd/users/646f28da49304c61bd6dc90164eb4dbe/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:10.395804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:10.398846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:10.481002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:10.513476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 856/1704] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:10.514300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe701-ec8e-47d1-913f-286b53cbdcfa None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.514689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe701-ec8e-47d1-913f-286b53cbdcfa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.524325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe701-ec8e-47d1-913f-286b53cbdcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.569233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8fdfe701-ec8e-47d1-913f-286b53cbdcfa None None] MFA Rules not processed for user `646f28da49304c61bd6dc90164eb4dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:10.570713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8fdfe701-ec8e-47d1-913f-286b53cbdcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:10.607197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:10.666134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaddf-2615-4724-9f3c-92ef64481848 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:10.672985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ddd01-421d-4169-b5ec-431a083a5680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:10.673647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ddd01-421d-4169-b5ec-431a083a5680 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.673925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ddd01-421d-4169-b5ec-431a083a5680 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.674190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ddd01-421d-4169-b5ec-431a083a5680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.696953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 857/1705] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:10.698080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfe701-ec8e-47d1-913f-286b53cbdcfa None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:10.747180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfe701-ec8e-47d1-913f-286b53cbdcfa None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:10.759388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:10.760083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.760366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.760628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.761288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:10.763777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:10.765386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:10.783720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ddd01-421d-4169-b5ec-431a083a5680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:10.785677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ddd01-421d-4169-b5ec-431a083a5680 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:10.794236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 858/1706] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:10.797063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 849/1707] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:10.798854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:10.799510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa0dc9-daaf-40e1-a591-10d2d9edfc87 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.799928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa0dc9-daaf-40e1-a591-10d2d9edfc87 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.800332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa0dc9-daaf-40e1-a591-10d2d9edfc87 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.803047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 850/1708] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 30 00:37:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:37:10.803946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa0dc9-daaf-40e1-a591-10d2d9edfc87 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:10.824223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b79fd-1a5e-4295-894a-703f288fe445 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:10.836356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:10.836705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa0dc9-daaf-40e1-a591-10d2d9edfc87 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:10.836987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.837275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.837536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.838325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:10.842091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:10.847668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239288c-25fb-4ba6-ae5d-d35ee0456894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:10.848506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239288c-25fb-4ba6-ae5d-d35ee0456894 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.848983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239288c-25fb-4ba6-ae5d-d35ee0456894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.849408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239288c-25fb-4ba6-ae5d-d35ee0456894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.850213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239288c-25fb-4ba6-ae5d-d35ee0456894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:10.852278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239288c-25fb-4ba6-ae5d-d35ee0456894 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:10.902279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 851/1709] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:10.904278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a5b1-9fb1-49e8-9e7a-562d2d3a5e73 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:10.904488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a5b1-9fb1-49e8-9e7a-562d2d3a5e73 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:10.904758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a5b1-9fb1-49e8-9e7a-562d2d3a5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:10.918198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 859/1710] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:10.918952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.017492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f051d-8c9b-4c91-8caf-bfe2cb64e0d8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.023266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1927a5b1-9fb1-49e8-9e7a-562d2d3a5e73 None None] MFA Rules not processed for user `77470d4430f04d30b64297de78e67f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:11.024513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1927a5b1-9fb1-49e8-9e7a-562d2d3a5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:11.025929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.026770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.027175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.027578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.028417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.031311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.069039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 860/1711] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:11.070212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.088820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa388385-43cf-42e2-8dda-5862373667d5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.100526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.101903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.102392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.102896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.103814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.108757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.137057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 852/1712] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:11.137776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927a5b1-9fb1-49e8-9e7a-562d2d3a5e73 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.156274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 861/1713] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:11 2022] POST /identity/v3/users => generated 297 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:11.157520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.158694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927a5b1-9fb1-49e8-9e7a-562d2d3a5e73 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.170441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7530-cb25-4f32-a0ca-70b487c5ed71 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.174350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.175023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.175315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.176097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.176776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.178232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.178447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.179203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.179435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.179903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.180617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.182776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.196648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 853/1714] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:11.197441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.203896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 862/1715] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:11.206214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.208034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:11.221514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caa8fa-f985-4952-8c7a-5e0386ff4710 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.227891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21d724-ef89-4c83-a918-9b21227a2a8b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.232830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.236439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.236841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.237219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.239173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.240437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.241077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.241682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.242033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.242154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.262466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 863/1716] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:11.271394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.276529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.278403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.290592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:11.298727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f1209-58e9-4f50-9b7b-f3514a7aa118 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.299854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 854/1717] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:11.300730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.305228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.306369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.306883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.307325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] PATH_INFO: `/v3/projects/34e2d05976974ee2b4b986f7e1566339/users/09be83fa41354eb693f1882f71cacf68/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.331890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc8d3a-871c-4ce1-97b1-c695382bb8a2 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.343372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17054d62-9bc6-4ccc-ab16-f257cb1655e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.344057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17054d62-9bc6-4ccc-ab16-f257cb1655e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.344749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17054d62-9bc6-4ccc-ab16-f257cb1655e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.345031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17054d62-9bc6-4ccc-ab16-f257cb1655e6 admin admin] PATH_INFO: `/v3/projects/fac54c1511104f3aa42e47566a4a89fd/users/2d470f7ff8a64e5ab283216dca9d7bb2/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.361986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e2d05976974ee2b4b986f7e1566339, user_id=09be83fa41354eb693f1882f71cacf68, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.365300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.378552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17054d62-9bc6-4ccc-ab16-f257cb1655e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac54c1511104f3aa42e47566a4a89fd, user_id=2d470f7ff8a64e5ab283216dca9d7bb2, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.381306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17054d62-9bc6-4ccc-ab16-f257cb1655e6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.398678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 864/1718] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:11 2022] PUT /identity/v3/projects/34e2d05976974ee2b4b986f7e1566339/users/09be83fa41354eb693f1882f71cacf68/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:11.399745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.420714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 855/1719] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:11 2022] PUT /identity/v3/projects/fac54c1511104f3aa42e47566a4a89fd/users/2d470f7ff8a64e5ab283216dca9d7bb2/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:11.431585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:11.433294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dcb78-47ac-4380-a7f1-f0a6e9c7d6e0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.433849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dcb78-47ac-4380-a7f1-f0a6e9c7d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.434282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dcb78-47ac-4380-a7f1-f0a6e9c7d6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.504405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-763dcb78-47ac-4380-a7f1-f0a6e9c7d6e0 None None] MFA Rules not processed for user `2d470f7ff8a64e5ab283216dca9d7bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:11.509092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-763dcb78-47ac-4380-a7f1-f0a6e9c7d6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:11.526446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb64a5-c38a-485a-887d-1f40f95e74ec admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.588261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04897ef8-b47f-4160-a5b6-949c08101f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.588873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897ef8-b47f-4160-a5b6-949c08101f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.589147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897ef8-b47f-4160-a5b6-949c08101f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.589412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04897ef8-b47f-4160-a5b6-949c08101f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.590293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897ef8-b47f-4160-a5b6-949c08101f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.591804 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04897ef8-b47f-4160-a5b6-949c08101f6f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.606511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 865/1720] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:11.608203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77b54-d1a5-4258-8231-e283e39f3418 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.608862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77b54-d1a5-4258-8231-e283e39f3418 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.608862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77b54-d1a5-4258-8231-e283e39f3418 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.610685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 866/1721] 10.222.0.42 () {54 vars in 912 bytes} [Tue Aug 30 00:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:37:11.612037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77b54-d1a5-4258-8231-e283e39f3418 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.630490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77b54-d1a5-4258-8231-e283e39f3418 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.635660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.637433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.637776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.638571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] PATH_INFO: `/v3/projects/34e2d05976974ee2b4b986f7e1566339/users/09be83fa41354eb693f1882f71cacf68/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.641380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e2d05976974ee2b4b986f7e1566339, user_id=09be83fa41354eb693f1882f71cacf68, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.645109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.653189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 856/1722] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:11.654597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7185c1-a507-49ed-a8a3-dd447fbeccee None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.654859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7185c1-a507-49ed-a8a3-dd447fbeccee None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.655126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7185c1-a507-49ed-a8a3-dd447fbeccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.665809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 867/1723] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:11 2022] PUT /identity/v3/projects/34e2d05976974ee2b4b986f7e1566339/users/09be83fa41354eb693f1882f71cacf68/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:11.666817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.696130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7f7185c1-a507-49ed-a8a3-dd447fbeccee None None] MFA Rules not processed for user `77470d4430f04d30b64297de78e67f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:11.698691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7f7185c1-a507-49ed-a8a3-dd447fbeccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:11.799947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 857/1724] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:11.810782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2e91-d23b-4140-8bf3-7723f9a005b0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.811399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2e91-d23b-4140-8bf3-7723f9a005b0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.811810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc2e91-d23b-4140-8bf3-7723f9a005b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.826765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77106962-f754-497e-beb9-985a007e5ef1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:11.838468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:11.839031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:11.839377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:11.839714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:11.840430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:11.842579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:11.865200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-81dc2e91-d23b-4140-8bf3-7723f9a005b0 None None] MFA Rules not processed for user `09be83fa41354eb693f1882f71cacf68`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:11.869324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-81dc2e91-d23b-4140-8bf3-7723f9a005b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:11.885490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 868/1725] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:11.893306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:11.896244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:11.941741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:11.972281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:11.976493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 858/1726] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:11.977590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2e91-d23b-4140-8bf3-7723f9a005b0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.004693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc2e91-d23b-4140-8bf3-7723f9a005b0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.035886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c62191-bda4-47be-9a01-f04ccb8ff581 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.040147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.041981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.042400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.042806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.055531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.057415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.069505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 869/1727] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:12.070642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.075232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:12.081452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.082253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.082892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.083385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.084288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.086413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.123302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 859/1728] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:11 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:12.125087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.145270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b4949-1eb7-4b36-9530-79e1aad02e05 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.156732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.159450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.160008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.161153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.162113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.167302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.196838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62b540-43f0-4ac7-9e6a-f9597b858501 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.197084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 860/1729] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:12.198544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.209810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195ddd-15f7-46c3-81ac-6e157766be24 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.210677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.212210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.214173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.214707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.215692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.216557 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.217096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.217618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] PATH_INFO: `/v3/projects/c8e3bd3ee87a43c198cff97bdfab7d0e/users/6650698718c04c619f5bd24a104231c3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.247434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e3bd3ee87a43c198cff97bdfab7d0e, user_id=6650698718c04c619f5bd24a104231c3, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.252549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.278263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 861/1730] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:12 2022] PUT /identity/v3/projects/c8e3bd3ee87a43c198cff97bdfab7d0e/users/6650698718c04c619f5bd24a104231c3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:12.280659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.386506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.388689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.405201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2b42c-6f0f-40ac-9763-ece81b911ef3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.412668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.413472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.413807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.414150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.414904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.423339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.433941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 870/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:12.439629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.447485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:12.466705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 862/1732] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:12.486372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.488670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ae29c-7b78-43a3-8ef8-b6722a08908e service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.500944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.501778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.502150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.503388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] PATH_INFO: `/v3/projects/fe27178cd9474c6ca23bff4d7139d5fe` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.507426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe27178cd9474c6ca23bff4d7139d5fe)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.508249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:37:12.508249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: warnings.warn(msg) Aug 30 00:37:12.508249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: Aug 30 00:37:12.509926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.545710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc854-a7f1-4a3c-83b9-4b42bf4e3189 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.551209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.552663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.553122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.553596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] PATH_INFO: `/v3/projects/c8e3bd3ee87a43c198cff97bdfab7d0e/users/6650698718c04c619f5bd24a104231c3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.556731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e3bd3ee87a43c198cff97bdfab7d0e, user_id=6650698718c04c619f5bd24a104231c3, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:12.561649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:12.596647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 863/1733] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:12 2022] PUT /identity/v3/projects/c8e3bd3ee87a43c198cff97bdfab7d0e/users/6650698718c04c619f5bd24a104231c3/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:12.597869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:12.600284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:12.700075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe27178cd9474c6ca23bff4d7139d5fe', 'request_id': 'req-d193b48d-7e6b-49fa-923b-f346c571f16c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:12.723752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe27178cd9474c6ca23bff4d7139d5fe', 'request_id': 'req-d193b48d-7e6b-49fa-923b-f346c571f16c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:12.733171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:12.735600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe27178cd9474c6ca23bff4d7139d5fe', 'request_id': 'req-d193b48d-7e6b-49fa-923b-f346c571f16c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:12.758306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:12.763640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] The token cache is being invalidate because project fe27178cd9474c6ca23bff4d7139d5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:12.764327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:12.765873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d193b48d-7e6b-49fa-923b-f346c571f16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:12.771629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 871/1734] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:12 2022] DELETE /identity/v3/projects/fe27178cd9474c6ca23bff4d7139d5fe => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:12.771629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.771629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:12.771629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:12.800988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f1589-20a9-4064-bcf5-f572e1dcf2ec admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:12.853316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] MFA Rules not processed for user `6650698718c04c619f5bd24a104231c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:12.854616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:12.993514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:12.997408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:12.998952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:13.002244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:13.004833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:13.047043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 872/1735] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:13.048036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:13.049464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:13.086821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:13.092502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:13.146234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 864/1736] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:13.149058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:13.153093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:13.162348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997496e-52e6-41c1-a5c4-e01aed76af6c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:13.174276 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:13.175167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:13.175572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:13.175944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:13.182033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:13.374790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:13.381681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:13.389789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0207-3a77-41b4-8e2d-227b55d7a4e9 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:13.402480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:13.406913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:13.407394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:13.408422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 873/1737] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:13.409360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:13.409596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] PATH_INFO: `/v3/users/8e6738f9ae0742128a4847536ff1c98e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:13.411602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:13.412515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6738f9ae0742128a4847536ff1c98e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:13.418567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:13.469271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e726-7e4f-48c3-969d-8ffeea203355 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:13.485789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:13.486423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:13.486704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:13.486973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:13.499249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6738f9ae0742128a4847536ff1c98e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:13.500161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6738f9ae0742128a4847536ff1c98e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:13.528691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:13.530189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:13.550567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6738f9ae0742128a4847536ff1c98e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:13.574964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6738f9ae0742128a4847536ff1c98e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:13.575894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6738f9ae0742128a4847536ff1c98e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:13.598508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:13.603971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 874/1738] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:13.666319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 865/1739] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:13 2022] DELETE /identity/v3/users/8e6738f9ae0742128a4847536ff1c98e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:13.827025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:13.840158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d129-7d7d-4dbd-a183-2de8c9abc524 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:13.914989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:13.979939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ebd6b-de98-40b1-857b-7590d29a6394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:13.980720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ebd6b-de98-40b1-857b-7590d29a6394 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:13.984412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ebd6b-de98-40b1-857b-7590d29a6394 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:13.984686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ebd6b-de98-40b1-857b-7590d29a6394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:13.993132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b76ebd6b-de98-40b1-857b-7590d29a6394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:14.133463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ebd6b-de98-40b1-857b-7590d29a6394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:14.138064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ebd6b-de98-40b1-857b-7590d29a6394 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:14.161644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 875/1740] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:14.756187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:14.757765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:14.906128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bbe3-9b7b-46e3-b531-2b650183126f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:14.921982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:14.922923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:14.923346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:14.923720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] PATH_INFO: `/v3/projects/3afb6d81c2d54e0092632052cfb60099` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:14.925909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afb6d81c2d54e0092632052cfb60099)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:14.954932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:15.055687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afb6d81c2d54e0092632052cfb60099', 'request_id': 'req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:15.067486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afb6d81c2d54e0092632052cfb60099', 'request_id': 'req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:15.080823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afb6d81c2d54e0092632052cfb60099', 'request_id': 'req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:15.110024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] The token cache is being invalidate because project 3afb6d81c2d54e0092632052cfb60099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:15.110878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:15.111060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-aa83cb7d-3327-4003-8c6d-bd6ce3c84c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:15.116868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 866/1741] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:14 2022] DELETE /identity/v3/projects/3afb6d81c2d54e0092632052cfb60099 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:15.119842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b51593-9635-4bef-ae24-7ab0f4c34e1b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:15.120626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b51593-9635-4bef-ae24-7ab0f4c34e1b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:15.120626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b51593-9635-4bef-ae24-7ab0f4c34e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:15.153798 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-68b51593-9635-4bef-ae24-7ab0f4c34e1b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:15.155698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-68b51593-9635-4bef-ae24-7ab0f4c34e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:15.236343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 876/1742] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:15.245752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fe197-1d59-4fa7-b604-5e6c89697925 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:15.246401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fe197-1d59-4fa7-b604-5e6c89697925 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:15.246850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fe197-1d59-4fa7-b604-5e6c89697925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:15.273708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-912fe197-1d59-4fa7-b604-5e6c89697925 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:15.275188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-912fe197-1d59-4fa7-b604-5e6c89697925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:15.293508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 867/1743] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:15.295679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b51593-9635-4bef-ae24-7ab0f4c34e1b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:15.312761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b51593-9635-4bef-ae24-7ab0f4c34e1b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:15.324732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:15.324732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:15.324732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:15.324732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:15.325653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:15.326102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:15.328757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:15.388224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 877/1744] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:37:15.393405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fe197-1d59-4fa7-b604-5e6c89697925 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:15.427656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fe197-1d59-4fa7-b604-5e6c89697925 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:15.464018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d4ae5-2962-43dc-abdb-114b56257e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:15.464662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d4ae5-2962-43dc-abdb-114b56257e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:15.464940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d4ae5-2962-43dc-abdb-114b56257e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:15.465206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d4ae5-2962-43dc-abdb-114b56257e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:15.468624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d4ae5-2962-43dc-abdb-114b56257e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:15.488675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d4ae5-2962-43dc-abdb-114b56257e0b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:15.645720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:15.646842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 868/1745] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:15 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:15.678665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7145d8-c07b-48f4-958a-c7742aa0e162 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:15.688338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ed4f-7fb5-4969-a28c-632de440e392 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:15.688693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ed4f-7fb5-4969-a28c-632de440e392 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:15.689048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ed4f-7fb5-4969-a28c-632de440e392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:15.814958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e3d5ed4f-7fb5-4969-a28c-632de440e392 None None] MFA Rules not processed for user `36cfdf71cf0b461894bb514c16032227`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:15.822175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e3d5ed4f-7fb5-4969-a28c-632de440e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:15.948943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:16.051444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 869/1746] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:16.051546 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3d0ec-7f78-439a-8681-ae7473f31efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:16.051546 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d0ec-7f78-439a-8681-ae7473f31efb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.051546 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d0ec-7f78-439a-8681-ae7473f31efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.051817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d0ec-7f78-439a-8681-ae7473f31efb admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.052678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3d0ec-7f78-439a-8681-ae7473f31efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:16.055840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba7ba-0bb7-4528-995a-a09b10f37cc5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.056820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3d0ec-7f78-439a-8681-ae7473f31efb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:16.069996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba7ba-0bb7-4528-995a-a09b10f37cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.069996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba7ba-0bb7-4528-995a-a09b10f37cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.126143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:16.139072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 878/1747] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:15 2022] POST /identity/v3/users => generated 294 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:16.139072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02a2e-a2cc-43ee-bf4b-a0fb90fe136c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.139649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5c0ba7ba-0bb7-4528-995a-a09b10f37cc5 None None] MFA Rules not processed for user `d8876e2cba404244b731450ff5112c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:16.139649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5c0ba7ba-0bb7-4528-995a-a09b10f37cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:16.139922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02a2e-a2cc-43ee-bf4b-a0fb90fe136c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.142322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02a2e-a2cc-43ee-bf4b-a0fb90fe136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.204997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-49c02a2e-a2cc-43ee-bf4b-a0fb90fe136c None None] MFA Rules not processed for user `36cfdf71cf0b461894bb514c16032227`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:16.206251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-49c02a2e-a2cc-43ee-bf4b-a0fb90fe136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:16.235398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 879/1748] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:16.237718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6b9d3-b599-4291-a86e-6a7d3741cdd0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.246599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6b9d3-b599-4291-a86e-6a7d3741cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.251859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6b9d3-b599-4291-a86e-6a7d3741cdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.307662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 870/1749] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:16.307845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba7ba-0bb7-4528-995a-a09b10f37cc5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:16.339072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4cf6b9d3-b599-4291-a86e-6a7d3741cdd0 None None] MFA Rules not processed for user `a330928e555a4f1ba17ab73d8c2f2914`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:16.340606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4cf6b9d3-b599-4291-a86e-6a7d3741cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:16.341000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba7ba-0bb7-4528-995a-a09b10f37cc5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:16.366819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:16.371297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.371615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.371899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.372594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:16.377521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:16.417914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 871/1750] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:16.420031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:16.441489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:16.562281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 880/1751] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:16.565179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6b9d3-b599-4291-a86e-6a7d3741cdd0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:16.593972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6b9d3-b599-4291-a86e-6a7d3741cdd0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:16.608250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:16.609007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.609358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.609864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.610651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:16.613629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:16.643992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 881/1752] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:16.645664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:16.677620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138653c-f402-46fd-aa21-a50943db5031 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:16.677987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322306-9172-4fc1-8675-c42345c96eeb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:16.687795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:16.690294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.691066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f629a-e17c-43e7-ac44-1790da1d980c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:16.691684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f629a-e17c-43e7-ac44-1790da1d980c service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.691959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f629a-e17c-43e7-ac44-1790da1d980c service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.692330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.692714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] PATH_INFO: `/v3/projects/c5ddbdac43c746d2880c756a8ebaf62e/users/84a0f841c1ee4c8dad36913c5e61d0b1/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.693755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f629a-e17c-43e7-ac44-1790da1d980c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.715888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f629a-e17c-43e7-ac44-1790da1d980c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:16.719276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f629a-e17c-43e7-ac44-1790da1d980c service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:16.739490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ddbdac43c746d2880c756a8ebaf62e, user_id=84a0f841c1ee4c8dad36913c5e61d0b1, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:16.746387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:16.752560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 872/1753] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:16.777418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 882/1754] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:16 2022] PUT /identity/v3/projects/c5ddbdac43c746d2880c756a8ebaf62e/users/84a0f841c1ee4c8dad36913c5e61d0b1/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:16.793346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f7fb-a399-4dd4-9a37-d506697e40d7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:16.793662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f7fb-a399-4dd4-9a37-d506697e40d7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:16.793945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f7fb-a399-4dd4-9a37-d506697e40d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:16.858566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3af0f7fb-a399-4dd4-9a37-d506697e40d7 None None] MFA Rules not processed for user `84a0f841c1ee4c8dad36913c5e61d0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:16.860016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3af0f7fb-a399-4dd4-9a37-d506697e40d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:16.978595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:17.028003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 873/1755] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:17.033082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:17.322682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a217e6-a29d-4103-82f9-d276a55e635f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:17.336391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:17.337901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:17.340203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:17.340960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:17.342247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:17.350583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:17.436051 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f7fb-a399-4dd4-9a37-d506697e40d7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:17.437183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 883/1756] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:17 2022] POST /identity/v3/projects => generated 385 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:17.466394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f7fb-a399-4dd4-9a37-d506697e40d7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:17.490137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:17.492472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:17.556597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:17.581326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8837-5c42-49f1-9428-d0c60774a315 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:17.589209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:17.590627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:17.590922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:17.591198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] PATH_INFO: `/v3/users/646f28da49304c61bd6dc90164eb4dbe` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:17.594220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=646f28da49304c61bd6dc90164eb4dbe)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:17.597048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:17.610859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:17.611492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:17.611913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:17.612194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:17.612841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:17.615063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:17.651487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 874/1757] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:17 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:17.655108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:17.682490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375523-f2c7-4998-a280-c51604dd306f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:17.691902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646f28da49304c61bd6dc90164eb4dbe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:17.708265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646f28da49304c61bd6dc90164eb4dbe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:17.710067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:17.710833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:17.710976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:17.711232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:17.712302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:17.714162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:17.745151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 875/1758] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:17.746147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:17.751874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646f28da49304c61bd6dc90164eb4dbe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:17.752620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646f28da49304c61bd6dc90164eb4dbe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:17.753256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1cd6d272-0e07-40dc-b3c6-ec2768ffed91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646f28da49304c61bd6dc90164eb4dbe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:17.770840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15955e4-38ad-4992-88eb-e8b64f246eb7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:17.779728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 884/1759] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:17 2022] DELETE /identity/v3/users/646f28da49304c61bd6dc90164eb4dbe => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:17.780104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efaa43-ae2a-42cd-a08c-29965f7c68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:17.780787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efaa43-ae2a-42cd-a08c-29965f7c68da admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:17.781067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efaa43-ae2a-42cd-a08c-29965f7c68da admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:17.781322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a910c5-5948-4ac3-9e1b-b9bb91ee2bb0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:17.781436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efaa43-ae2a-42cd-a08c-29965f7c68da admin admin] PATH_INFO: `/v3/projects/072c2bfab5e24aee88b940d1eb103283/users/c6570be545ba49b49df9e9433428ade8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:17.781637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a910c5-5948-4ac3-9e1b-b9bb91ee2bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:17.781916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a910c5-5948-4ac3-9e1b-b9bb91ee2bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:17.818209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efaa43-ae2a-42cd-a08c-29965f7c68da admin admin] RBAC: Authorizing `identity:create_grant(project_id=072c2bfab5e24aee88b940d1eb103283, user_id=c6570be545ba49b49df9e9433428ade8, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:17.821126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efaa43-ae2a-42cd-a08c-29965f7c68da admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:17.849094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 876/1760] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:17 2022] PUT /identity/v3/projects/072c2bfab5e24aee88b940d1eb103283/users/c6570be545ba49b49df9e9433428ade8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:17.854216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:17.854717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:17.855210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:17.881070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:17.884169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:17.899358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-50a910c5-5948-4ac3-9e1b-b9bb91ee2bb0 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:17.900773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-50a910c5-5948-4ac3-9e1b-b9bb91ee2bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:18.035050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 877/1761] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:18.036057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:18.039014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:18.067938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfabf18-0ea1-4759-b68e-c49d01bfa9af None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:18.070377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 885/1762] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:18.075441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:18.076082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:18.076502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:18.076777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:18.077429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:18.079082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:18.130952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a910c5-5948-4ac3-9e1b-b9bb91ee2bb0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:18.142087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 878/1763] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:18.150775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a910c5-5948-4ac3-9e1b-b9bb91ee2bb0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:18.171644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e555f7-8811-4bf9-ad53-9309a6714d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:18.172352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e555f7-8811-4bf9-ad53-9309a6714d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:18.172607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e555f7-8811-4bf9-ad53-9309a6714d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:18.172875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e555f7-8811-4bf9-ad53-9309a6714d26 admin admin] PATH_INFO: `/v3/projects/072c2bfab5e24aee88b940d1eb103283/users/c6570be545ba49b49df9e9433428ade8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:18.174963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e555f7-8811-4bf9-ad53-9309a6714d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072c2bfab5e24aee88b940d1eb103283, user_id=c6570be545ba49b49df9e9433428ade8, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:18.177928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e555f7-8811-4bf9-ad53-9309a6714d26 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:18.186697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:18.190617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:18.230740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 886/1764] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:18 2022] PUT /identity/v3/projects/072c2bfab5e24aee88b940d1eb103283/users/c6570be545ba49b49df9e9433428ade8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:18.242537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:18.242827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:18.243099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:18.304756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:18.346057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] MFA Rules not processed for user `c6570be545ba49b49df9e9433428ade8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:18.347267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:18.390933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed70c7-d0b1-44eb-bc68-25bdbd6e6a6c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:18.397516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:18.602365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:18.602902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:18.603238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:18.603511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:18.637330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 887/1765] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:18.643992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:18.651866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:18.783662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:18.789279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:18.813634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 879/1766] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:18.815356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:18.818381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:18.932194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c557e-3e10-4a26-a3b9-07b4863ddd6f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:18.951338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5fc01-e3ed-4918-b52b-a0cba3112835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:18.954260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5fc01-e3ed-4918-b52b-a0cba3112835 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:18.954595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5fc01-e3ed-4918-b52b-a0cba3112835 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:18.955214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5fc01-e3ed-4918-b52b-a0cba3112835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:19.065528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2f129-0642-46ef-a5cd-d9020fc8c4d5 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:19.085956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:19.086818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:19.087098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:19.087365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:19.112678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:19.115579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:19.141422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 880/1767] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:19.143495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5fc01-e3ed-4918-b52b-a0cba3112835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:19.145441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5fc01-e3ed-4918-b52b-a0cba3112835 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:19.176457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 888/1768] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:37:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:37:19.239480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:19.266115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab9233-a59a-457f-bbef-c395918b953d service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:19.300083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:19.303875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:19.304156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:19.304435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] PATH_INFO: `/v3/users/84a0f841c1ee4c8dad36913c5e61d0b1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:19.316671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a0f841c1ee4c8dad36913c5e61d0b1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:19.332992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:19.487626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:19.525892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a0f841c1ee4c8dad36913c5e61d0b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:19.527615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a0f841c1ee4c8dad36913c5e61d0b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:19.553887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a0f841c1ee4c8dad36913c5e61d0b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:19.578121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a0f841c1ee4c8dad36913c5e61d0b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:19.579283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a0f841c1ee4c8dad36913c5e61d0b1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:19.646721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bf2d-e6d3-4a68-8fa1-80ebe0397257 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:19.647286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bf2d-e6d3-4a68-8fa1-80ebe0397257 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:19.647286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6bf2d-e6d3-4a68-8fa1-80ebe0397257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:19.650722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 881/1769] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:19 2022] DELETE /identity/v3/users/84a0f841c1ee4c8dad36913c5e61d0b1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:19.711516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3ab6bf2d-e6d3-4a68-8fa1-80ebe0397257 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:19.721012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3ab6bf2d-e6d3-4a68-8fa1-80ebe0397257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:19.826769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:19.914980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 889/1770] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:19.984908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:19.987058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:20.229530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc74d9-eab3-4228-800d-f3ee56f1e925 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:20.262355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:20.263001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:20.263278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:20.263546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:20.302350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:20.307631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:20.354550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 882/1771] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:21.325606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029205d-072a-4ca2-9844-6b58820d9cc8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:21.326138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029205d-072a-4ca2-9844-6b58820d9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:21.326211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029205d-072a-4ca2-9844-6b58820d9cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:21.434776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8029205d-072a-4ca2-9844-6b58820d9cc8 None None] MFA Rules not processed for user `36cfdf71cf0b461894bb514c16032227`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:21.438418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8029205d-072a-4ca2-9844-6b58820d9cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:21.593331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 890/1772] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:21.678366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:21.684828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:21.756027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7fb61-bf9e-4536-a048-20f9ed5dd83d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:21.776367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:21.780799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:21.781097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:21.781616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] PATH_INFO: `/v3/projects/4036422be6b740b8af16d865c6350cdd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:21.839818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4036422be6b740b8af16d865c6350cdd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:21.847677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:22.031333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4036422be6b740b8af16d865c6350cdd', 'request_id': 'req-562271f8-3b28-4d53-b52e-7852bc5f7d13'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.059717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4036422be6b740b8af16d865c6350cdd', 'request_id': 'req-562271f8-3b28-4d53-b52e-7852bc5f7d13'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.080439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4036422be6b740b8af16d865c6350cdd', 'request_id': 'req-562271f8-3b28-4d53-b52e-7852bc5f7d13'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.103214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] The token cache is being invalidate because project 4036422be6b740b8af16d865c6350cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:22.104256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.122520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562271f8-3b28-4d53-b52e-7852bc5f7d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.140810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 883/1773] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:21 2022] DELETE /identity/v3/projects/4036422be6b740b8af16d865c6350cdd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:22.141988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029205d-072a-4ca2-9844-6b58820d9cc8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:22.159592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029205d-072a-4ca2-9844-6b58820d9cc8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:22.359367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:22.360074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:22.360341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:22.360619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] PATH_INFO: `/v3/users/09be83fa41354eb693f1882f71cacf68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:22.361883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=09be83fa41354eb693f1882f71cacf68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:22.364937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:22.475755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09be83fa41354eb693f1882f71cacf68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.530372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09be83fa41354eb693f1882f71cacf68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.576604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09be83fa41354eb693f1882f71cacf68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.584958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09be83fa41354eb693f1882f71cacf68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.594065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09be83fa41354eb693f1882f71cacf68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:22.607357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:22.658270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 891/1774] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:22 2022] DELETE /identity/v3/users/09be83fa41354eb693f1882f71cacf68 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:22.966732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c431d-d040-4260-a800-e16c801fe836 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:22.967632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c431d-d040-4260-a800-e16c801fe836 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:22.968212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c431d-d040-4260-a800-e16c801fe836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:23.060512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-988c431d-d040-4260-a800-e16c801fe836 None None] MFA Rules not processed for user `77470d4430f04d30b64297de78e67f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:23.066434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-988c431d-d040-4260-a800-e16c801fe836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:23.221601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:23.326150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 884/1775] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Aug 30 00:37:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:23.543640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:23.546319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:23.566840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a17cc3-488d-43cb-9720-b10db67833ef admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:23.608487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:23.609460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:23.617328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:23.617720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:23.638973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c431d-d040-4260-a800-e16c801fe836 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:23.640602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-988c431d-d040-4260-a800-e16c801fe836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:23.657452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c431d-d040-4260-a800-e16c801fe836 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:23.659054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:23.660896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:23.671041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:23.671669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:23.671944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:23.672207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:23.690458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:23.691945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:23.693321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 892/1776] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:23.731416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 885/1777] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:37:24.533700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:24.536069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:24.697688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc2b17-c33f-4c01-8d8b-fadaa5e332b7 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:24.722099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:24.724426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:24.725106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:24.725953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] PATH_INFO: `/v3/projects/c5ddbdac43c746d2880c756a8ebaf62e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:24.729862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ddbdac43c746d2880c756a8ebaf62e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:24.750776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:24.919894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ddbdac43c746d2880c756a8ebaf62e', 'request_id': 'req-c3be4119-99b3-4016-a59d-034b287a3c73'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:24.950583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ddbdac43c746d2880c756a8ebaf62e', 'request_id': 'req-c3be4119-99b3-4016-a59d-034b287a3c73'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:24.970645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ddbdac43c746d2880c756a8ebaf62e', 'request_id': 'req-c3be4119-99b3-4016-a59d-034b287a3c73'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.000426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] The token cache is being invalidate because project c5ddbdac43c746d2880c756a8ebaf62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:25.001336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.003478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.012661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 893/1778] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:24 2022] DELETE /identity/v3/projects/c5ddbdac43c746d2880c756a8ebaf62e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:25.016630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:25.039344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2a3e5-a538-418b-95d8-9e9837c05bf1 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:25.236644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:25.237318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:25.237644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:25.238091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] PATH_INFO: `/v3/users/c6570be545ba49b49df9e9433428ade8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:25.245905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6570be545ba49b49df9e9433428ade8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:25.248043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:25.350986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6570be545ba49b49df9e9433428ade8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.353324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6570be545ba49b49df9e9433428ade8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.372422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6570be545ba49b49df9e9433428ade8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.404630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6570be545ba49b49df9e9433428ade8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.407589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bf8205ad-e3f3-4991-b6f4-f334e4ed7af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6570be545ba49b49df9e9433428ade8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:25.480572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 886/1779] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:25 2022] DELETE /identity/v3/users/c6570be545ba49b49df9e9433428ade8 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:25.908370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:25.909927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:25.953004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be4119-99b3-4016-a59d-034b287a3c73 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:26.051854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:26.054739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:26.056766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:26.058319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] PATH_INFO: `/v3/projects/34e2d05976974ee2b4b986f7e1566339` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:26.062250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e2d05976974ee2b4b986f7e1566339)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:26.067373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:26.112714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:26.196818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e2d05976974ee2b4b986f7e1566339', 'request_id': 'req-695f7793-0d73-4137-aa0a-88d2dbd24d43'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:26.208567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e2d05976974ee2b4b986f7e1566339', 'request_id': 'req-695f7793-0d73-4137-aa0a-88d2dbd24d43'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:26.220122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e2d05976974ee2b4b986f7e1566339', 'request_id': 'req-695f7793-0d73-4137-aa0a-88d2dbd24d43'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:26.247609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] The token cache is being invalidate because project 34e2d05976974ee2b4b986f7e1566339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:26.247961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:26.248678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-695f7793-0d73-4137-aa0a-88d2dbd24d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:26.255056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 894/1780] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:25 2022] DELETE /identity/v3/projects/34e2d05976974ee2b4b986f7e1566339 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:26.256587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27efcd-4641-4b67-9e09-4d38d043ca60 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:26.257058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27efcd-4641-4b67-9e09-4d38d043ca60 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:26.257195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27efcd-4641-4b67-9e09-4d38d043ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:26.286250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-db27efcd-4641-4b67-9e09-4d38d043ca60 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:26.287719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-db27efcd-4641-4b67-9e09-4d38d043ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:26.399325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:26.437131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 887/1781] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:26.445637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f259-3c09-4f3d-b10e-b1e2615012b7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:26.445952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f259-3c09-4f3d-b10e-b1e2615012b7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:26.446259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f259-3c09-4f3d-b10e-b1e2615012b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:26.494800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6a14f259-3c09-4f3d-b10e-b1e2615012b7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:26.496301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6a14f259-3c09-4f3d-b10e-b1e2615012b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:26.569980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 895/1782] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:26.576685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27efcd-4641-4b67-9e09-4d38d043ca60 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:26.605760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27efcd-4641-4b67-9e09-4d38d043ca60 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:26.616494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:26.623081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:26.624934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:26.627155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:26.641776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:26.643391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:26.645255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:26.683703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 888/1783] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:26.690011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14f259-3c09-4f3d-b10e-b1e2615012b7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:26.708370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14f259-3c09-4f3d-b10e-b1e2615012b7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:26.736793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:26.737615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:26.739245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:26.740411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:26.741507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:26.743795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:26.828674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:26.845253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 896/1784] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:26 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:26.855395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86c8f3-966a-44b7-b0c7-0f37559d3e4e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:27.113164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:27.114657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:27.114939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:27.116758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:27.117576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:27.120011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:27.183809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 889/1785] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:26 2022] POST /identity/v3/users => generated 289 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:27.187481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:27.202893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c8dae-5a4c-4c41-b1a6-e03e3520a2c0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:27.216392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:27.216917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:27.217198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:27.217475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:27.220180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:27.223340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:27.247225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 897/1786] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:27.252143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:27.265817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90b0a-661c-4bd8-afc8-5aec9c368ae4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:27.278114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ba1a5-11fa-44d3-aa8b-28959dbbe953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:27.279500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba1a5-11fa-44d3-aa8b-28959dbbe953 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:27.279787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba1a5-11fa-44d3-aa8b-28959dbbe953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:27.280088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ba1a5-11fa-44d3-aa8b-28959dbbe953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:27.280788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ba1a5-11fa-44d3-aa8b-28959dbbe953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:27.314671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ba1a5-11fa-44d3-aa8b-28959dbbe953 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:27.341514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:27.348492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 890/1787] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:27.353201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0361da-ef01-48ad-8b53-14ba74518c0e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:27.359300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:27.360084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:27.360586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:27.361113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] PATH_INFO: `/v3/projects/105ea78a84bd4855bacc9272607d60b8/users/e4f0497f299b43889a71e428c1e3a941/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:27.425063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105ea78a84bd4855bacc9272607d60b8, user_id=e4f0497f299b43889a71e428c1e3a941, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:27.427942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:27.476918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 898/1788] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:27 2022] PUT /identity/v3/projects/105ea78a84bd4855bacc9272607d60b8/users/e4f0497f299b43889a71e428c1e3a941/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:27.488261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2650b-9d04-41ba-88ad-a8a1c0f1f0e5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:27.488664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2650b-9d04-41ba-88ad-a8a1c0f1f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:27.489043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2650b-9d04-41ba-88ad-a8a1c0f1f0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:27.541370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d5d2650b-9d04-41ba-88ad-a8a1c0f1f0e5 None None] MFA Rules not processed for user `e4f0497f299b43889a71e428c1e3a941`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:27.542867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d5d2650b-9d04-41ba-88ad-a8a1c0f1f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:27.696289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 891/1789] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:27.712668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:27.714668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:27.829899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ef057-1883-4c92-83ea-afeb3d6a3ad3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:27.840709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee05d1b-e493-48c3-88bb-a4a0afab045c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:27.841674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee05d1b-e493-48c3-88bb-a4a0afab045c service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:27.842095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee05d1b-e493-48c3-88bb-a4a0afab045c service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:27.842503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee05d1b-e493-48c3-88bb-a4a0afab045c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:27.859377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee05d1b-e493-48c3-88bb-a4a0afab045c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:27.863947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee05d1b-e493-48c3-88bb-a4a0afab045c service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:27.899193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 899/1790] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:27.931743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98d95-26aa-4b1c-bfe8-9f169cfa4b50 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:27.932314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98d95-26aa-4b1c-bfe8-9f169cfa4b50 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:27.932613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98d95-26aa-4b1c-bfe8-9f169cfa4b50 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:27.934705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 892/1791] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:37:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:37:27.999906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:28.000277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:28.001058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:28.045787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:28.048737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:28.198515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:28.302876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 900/1792] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:29.179877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98d95-26aa-4b1c-bfe8-9f169cfa4b50 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:29.182625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7ea98d95-26aa-4b1c-bfe8-9f169cfa4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:29.212813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98d95-26aa-4b1c-bfe8-9f169cfa4b50 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:29.220100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd33d7b-2c72-4b24-82e6-cbabb447e919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:29.221252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd33d7b-2c72-4b24-82e6-cbabb447e919 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:29.221826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd33d7b-2c72-4b24-82e6-cbabb447e919 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:29.222296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd33d7b-2c72-4b24-82e6-cbabb447e919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:29.247509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd33d7b-2c72-4b24-82e6-cbabb447e919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:29.250801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd33d7b-2c72-4b24-82e6-cbabb447e919 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:29.279208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 893/1793] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:29.319546 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:29.322926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:29.529811 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca70daa-e8f1-4a37-a59b-5d47defcc633 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:29.536489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:29.538150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:29.538687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:29.539341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] PATH_INFO: `/v3/projects/072c2bfab5e24aee88b940d1eb103283` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:29.556382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072c2bfab5e24aee88b940d1eb103283)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:29.565898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:29.699039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072c2bfab5e24aee88b940d1eb103283', 'request_id': 'req-54fd5659-d44b-4b33-8b22-9e1164cec094'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:29.710465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072c2bfab5e24aee88b940d1eb103283', 'request_id': 'req-54fd5659-d44b-4b33-8b22-9e1164cec094'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:29.726500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072c2bfab5e24aee88b940d1eb103283', 'request_id': 'req-54fd5659-d44b-4b33-8b22-9e1164cec094'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:29.749980 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659a42-f90b-493e-a8ef-1d5e38a42f7c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:29.750331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659a42-f90b-493e-a8ef-1d5e38a42f7c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:29.750594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659a42-f90b-493e-a8ef-1d5e38a42f7c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:29.752413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 894/1794] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:37:29.762419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] The token cache is being invalidate because project 072c2bfab5e24aee88b940d1eb103283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:29.764666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:29.766790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-54fd5659-d44b-4b33-8b22-9e1164cec094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:29.775013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 901/1795] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:29 2022] DELETE /identity/v3/projects/072c2bfab5e24aee88b940d1eb103283 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:29.779232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9a50d-962c-4e17-b40c-8104de249d7b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:29.781763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9a50d-962c-4e17-b40c-8104de249d7b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:29.783982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9a50d-962c-4e17-b40c-8104de249d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:29.798839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9967a2-d0fa-49a6-afc6-613074bf11a6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:29.799432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9967a2-d0fa-49a6-afc6-613074bf11a6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:29.799942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9967a2-d0fa-49a6-afc6-613074bf11a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:29.848275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9db9a50d-962c-4e17-b40c-8104de249d7b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:29.849182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9db9a50d-962c-4e17-b40c-8104de249d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:29.855113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2d9967a2-d0fa-49a6-afc6-613074bf11a6 None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:29.859368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2d9967a2-d0fa-49a6-afc6-613074bf11a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:29.938090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:30.004879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 895/1796] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:30.010146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.010433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.010716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.015328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:30.052458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:30.053766 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:30.061015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 902/1797] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:30.075264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 896/1798] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:30.082635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9967a2-d0fa-49a6-afc6-613074bf11a6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:30.143477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9967a2-d0fa-49a6-afc6-613074bf11a6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:30.176781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:30.179395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.179741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.180702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.182799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:30.184315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:30.188057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:30.201448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:30.203627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:30.241844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 903/1799] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:30.242446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955b4ad-d96f-4c5c-af56-d0ee9ed5b393 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:30.247307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:30.251317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:30.252322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.252809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.253487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.279317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4a25-73ad-4aec-bbad-6f6686deb4a3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:30.280349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:30.282012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:30.310002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:30.310705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.310895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.311166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.314953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:30.327956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:30.341916 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 897/1800] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:30.439724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 904/1801] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:30 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:30.440236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:30.459836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ef988-7bec-4769-9b8a-bf94cdf68323 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:30.614854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:30.616921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.621094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.621652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.622662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:30.624875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:30.697573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 898/1802] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:30 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:30.702131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:30.716448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8677-69eb-4b3b-810b-96bfb6dc7f96 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:30.731433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:30.732064 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.732335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.732600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.733245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:30.739640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:30.767598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 905/1803] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:30.768628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:30.783020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787b1b-40d0-40d0-b4d5-e1ba4aacee20 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:30.787972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394ffd7-68e0-4bdc-bac7-a06d7607242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:30.788592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394ffd7-68e0-4bdc-bac7-a06d7607242f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.788867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394ffd7-68e0-4bdc-bac7-a06d7607242f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.789139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394ffd7-68e0-4bdc-bac7-a06d7607242f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.789848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394ffd7-68e0-4bdc-bac7-a06d7607242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:30.791700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394ffd7-68e0-4bdc-bac7-a06d7607242f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:30.818842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 899/1804] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:30.823729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:30.844622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad60d9-9051-48cf-ac1b-1a3953fc4600 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:30.859244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:30.860445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.860936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.862368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] PATH_INFO: `/v3/projects/a45c7c8336db45bab1d25fade60debdf/users/520115f8a24c4604b1490fe126c426b5/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:30.915027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45c7c8336db45bab1d25fade60debdf, user_id=520115f8a24c4604b1490fe126c426b5, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:30.927521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:30.954834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 906/1805] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:30 2022] PUT /identity/v3/projects/a45c7c8336db45bab1d25fade60debdf/users/520115f8a24c4604b1490fe126c426b5/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:30.966863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b58c5-7967-4c14-9db3-35787abff5a5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:30.967156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b58c5-7967-4c14-9db3-35787abff5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:30.967430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b58c5-7967-4c14-9db3-35787abff5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:31.052501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-905b58c5-7967-4c14-9db3-35787abff5a5 None None] MFA Rules not processed for user `520115f8a24c4604b1490fe126c426b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:31.054082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-905b58c5-7967-4c14-9db3-35787abff5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:31.224306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 900/1806] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:31.229766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:31.500125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7630c-63a0-40bb-a865-911d8f934018 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:31.522081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:31.523285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:31.523669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:31.524614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:31.525453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:31.528886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:31.603888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 907/1807] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:31 2022] POST /identity/v3/projects => generated 379 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:31.608469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b58c5-7967-4c14-9db3-35787abff5a5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:31.627996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b58c5-7967-4c14-9db3-35787abff5a5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:31.716821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:31.836790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:31.837768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:31.838171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:31.838532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:31.839417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:31.842170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:31.894719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 901/1808] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:31 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:31.898779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:31.931045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a791-9277-48c2-82fa-007a53bd1b44 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:31.940528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:31.942150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:31.944839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:31.945227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:31.947265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:31.951591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:31.980613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 908/1809] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:31.985016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:32.018998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abcdd-0ecf-4843-8e25-7dcef9366484 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:32.032912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:32.039921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:32.040888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:32.041534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] PATH_INFO: `/v3/projects/ffa44fb2f15e470b824143685ec3cf0b/users/87f01ae9b69d4474ba41217ad8abe2e1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:32.092087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa44fb2f15e470b824143685ec3cf0b, user_id=87f01ae9b69d4474ba41217ad8abe2e1, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:32.095261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:32.130194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 902/1810] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:31 2022] PUT /identity/v3/projects/ffa44fb2f15e470b824143685ec3cf0b/users/87f01ae9b69d4474ba41217ad8abe2e1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:32.134833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:32.147920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da315ff-ffcd-4436-8905-db257533d77e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:32.254018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95d17e-426b-4230-94c2-de96546c7d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:32.254637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95d17e-426b-4230-94c2-de96546c7d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:32.254911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95d17e-426b-4230-94c2-de96546c7d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:32.255376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95d17e-426b-4230-94c2-de96546c7d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:32.256025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95d17e-426b-4230-94c2-de96546c7d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:32.257652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95d17e-426b-4230-94c2-de96546c7d62 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:32.259371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:32.274536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 909/1811] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:32.276092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:32.290974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdde26-9dac-474d-bd2e-182d5dcc7c87 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:32.297770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:32.298516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:32.298796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:32.299200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] PATH_INFO: `/v3/projects/ffa44fb2f15e470b824143685ec3cf0b/users/87f01ae9b69d4474ba41217ad8abe2e1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:32.302263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa44fb2f15e470b824143685ec3cf0b, user_id=87f01ae9b69d4474ba41217ad8abe2e1, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:32.305641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:32.328389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 903/1812] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:32 2022] PUT /identity/v3/projects/ffa44fb2f15e470b824143685ec3cf0b/users/87f01ae9b69d4474ba41217ad8abe2e1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:32.330161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce62b27-7836-402c-ae39-aced31dbb562 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:32.330484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce62b27-7836-402c-ae39-aced31dbb562 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:32.330708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce62b27-7836-402c-ae39-aced31dbb562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:32.371190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fce62b27-7836-402c-ae39-aced31dbb562 None None] MFA Rules not processed for user `87f01ae9b69d4474ba41217ad8abe2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:32.372763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fce62b27-7836-402c-ae39-aced31dbb562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:32.491706 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 910/1813] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:32.504492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:32.506390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:32.579196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea1207-9271-4f19-b7d3-f91bf5ad1b61 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:32.583759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:32.583912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:32.584264 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:32.584890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:32.599919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:32.602384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:32.627023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 904/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:33.065023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce62b27-7836-402c-ae39-aced31dbb562 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:33.074847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce62b27-7836-402c-ae39-aced31dbb562 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:33.079776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f01ae9b69d4474ba41217ad8abe2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffa44fb2f15e470b824143685ec3cf0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:33.080399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:33.080690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:33.080967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:33.081664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:33.081973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:33.083714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:33.100099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 911/1815] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:33.101321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:33.110910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a244cb-9929-4b8c-95f3-49b7a7a7675e service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:33.115546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f01ae9b69d4474ba41217ad8abe2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffa44fb2f15e470b824143685ec3cf0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:33.116485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:33.116786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:33.117061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:33.117946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:33.119872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:33.157664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 905/1816] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:33 2022] POST /identity/v3/projects => generated 354 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:33.158977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:33.169988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a9690-e9fc-43e1-9db9-01ab86113c9e tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:33.234909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f01ae9b69d4474ba41217ad8abe2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffa44fb2f15e470b824143685ec3cf0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:33.235462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:33.235776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:33.236156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:33.236880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:33.237208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:33.239069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:33.257436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 912/1817] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:33.302558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:33.314583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ba9c2-18e7-49b5-9d30-f8a00aa97831 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:33.320528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f01ae9b69d4474ba41217ad8abe2e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffa44fb2f15e470b824143685ec3cf0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:33.321182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:33.321464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:33.322267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] PATH_INFO: `/v3/projects/b7c0174191c041a09de7d0087c00b633` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:33.323316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7c0174191c041a09de7d0087c00b633)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:33.325242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:33.387209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c0174191c041a09de7d0087c00b633', 'request_id': 'req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:33.399543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:33.401202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c0174191c041a09de7d0087c00b633', 'request_id': 'req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:33.415718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c0174191c041a09de7d0087c00b633', 'request_id': 'req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:33.432811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] The token cache is being invalidate because project b7c0174191c041a09de7d0087c00b633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:33.433249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:33.436862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4037580-bb9a-4b7d-ad4e-e4c142f0b833 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:33.441605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 906/1818] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:33 2022] DELETE /identity/v3/projects/b7c0174191c041a09de7d0087c00b633 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:33.802561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:33.804301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:33.903038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6091-8dcf-429c-8b04-bd7c4cc3e565 tempest-VolumeQuotaClassesTest-668655254 tempest-VolumeQuotaClassesTest-668655254-project-admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:33.908595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:33.989905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:33.991421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:33.991790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:33.992782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] PATH_INFO: `/v3/users/520115f8a24c4604b1490fe126c426b5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:33.994175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520115f8a24c4604b1490fe126c426b5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:33.996197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:34.062641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520115f8a24c4604b1490fe126c426b5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.085843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520115f8a24c4604b1490fe126c426b5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.100214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520115f8a24c4604b1490fe126c426b5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.101031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520115f8a24c4604b1490fe126c426b5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.102114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520115f8a24c4604b1490fe126c426b5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.148062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 913/1819] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:33 2022] DELETE /identity/v3/users/520115f8a24c4604b1490fe126c426b5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:34.153885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:34.154422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:34.155118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:34.190170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:34.191602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:34.277506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 907/1820] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:34.288681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:34.290048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:34.352934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66544f74-48d7-422a-b0f2-367d386a2d14 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:34.357794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:34.358348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:34.358641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:34.358903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:34.371479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:34.373119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:34.405455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 914/1821] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:34.816479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:34.818993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:34.839108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd6522-c9f2-46c6-9011-7456a0b37cf1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:34.846430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:34.847292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:34.847771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:34.848437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] PATH_INFO: `/v3/projects/a45c7c8336db45bab1d25fade60debdf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:34.850029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45c7c8336db45bab1d25fade60debdf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:34.852580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:34.915048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45c7c8336db45bab1d25fade60debdf', 'request_id': 'req-abeb67ef-d6b2-4380-b110-0c01145ab2e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.925331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45c7c8336db45bab1d25fade60debdf', 'request_id': 'req-abeb67ef-d6b2-4380-b110-0c01145ab2e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.936312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45c7c8336db45bab1d25fade60debdf', 'request_id': 'req-abeb67ef-d6b2-4380-b110-0c01145ab2e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.951789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] The token cache is being invalidate because project a45c7c8336db45bab1d25fade60debdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:34.952458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.953314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:34.955409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 908/1822] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:34 2022] DELETE /identity/v3/projects/a45c7c8336db45bab1d25fade60debdf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:34.959610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:34.969838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae957e1-5b84-4b7c-a5b6-b92443f99b96 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:35.001197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:35.040968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:35.041674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:35.042049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:35.042484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] PATH_INFO: `/v3/users/87f01ae9b69d4474ba41217ad8abe2e1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:35.044166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f01ae9b69d4474ba41217ad8abe2e1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:35.046281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:35.114230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f01ae9b69d4474ba41217ad8abe2e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:35.133313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f01ae9b69d4474ba41217ad8abe2e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:35.142224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f01ae9b69d4474ba41217ad8abe2e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:35.143317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f01ae9b69d4474ba41217ad8abe2e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:35.144165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-01c24e2e-64e7-43d8-a3e1-6bf48814ab7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f01ae9b69d4474ba41217ad8abe2e1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:35.161320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 915/1823] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:34 2022] DELETE /identity/v3/users/87f01ae9b69d4474ba41217ad8abe2e1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:35.972754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:35.977123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:36.006174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb67ef-d6b2-4380-b110-0c01145ab2e9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.076034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.076680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.077096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.077218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] PATH_INFO: `/v3/projects/ffa44fb2f15e470b824143685ec3cf0b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.078395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa44fb2f15e470b824143685ec3cf0b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.080486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:36.089119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:36.130171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa44fb2f15e470b824143685ec3cf0b', 'request_id': 'req-2224183e-7857-45f8-85ed-51bb9960e45f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:36.136397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa44fb2f15e470b824143685ec3cf0b', 'request_id': 'req-2224183e-7857-45f8-85ed-51bb9960e45f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:36.146261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa44fb2f15e470b824143685ec3cf0b', 'request_id': 'req-2224183e-7857-45f8-85ed-51bb9960e45f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:36.158257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] The token cache is being invalidate because project ffa44fb2f15e470b824143685ec3cf0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:36.158522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:36.159142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2224183e-7857-45f8-85ed-51bb9960e45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:36.160630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 909/1824] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:35 2022] DELETE /identity/v3/projects/ffa44fb2f15e470b824143685ec3cf0b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:36.165969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b76e7-bc8a-4727-ad07-f7d5bb8f58e8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.166443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b76e7-bc8a-4727-ad07-f7d5bb8f58e8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.166574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b76e7-bc8a-4727-ad07-f7d5bb8f58e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.189728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-641b76e7-bc8a-4727-ad07-f7d5bb8f58e8 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:36.190960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-641b76e7-bc8a-4727-ad07-f7d5bb8f58e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:36.310683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 916/1825] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:36.313951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfc111-e561-463b-b26a-7c9724bea3a7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.314475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfc111-e561-463b-b26a-7c9724bea3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.315063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfc111-e561-463b-b26a-7c9724bea3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.338084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aedfc111-e561-463b-b26a-7c9724bea3a7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:36.339856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aedfc111-e561-463b-b26a-7c9724bea3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:36.352675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 910/1826] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:36.353945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b76e7-bc8a-4727-ad07-f7d5bb8f58e8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:36.364776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b76e7-bc8a-4727-ad07-f7d5bb8f58e8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.370262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.370886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.371175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.371442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.372101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:36.372405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.374441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:36.399576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 917/1827] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:36.406868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfc111-e561-463b-b26a-7c9724bea3a7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:36.418639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfc111-e561-463b-b26a-7c9724bea3a7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.425887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.426518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.426800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.427127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.427912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.430022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:36.473468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 911/1828] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:36 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:36.477451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:36.492044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7ce7b-232d-40f0-8a0c-d48664a8feb4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.536866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:36.565621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.566266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.566564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.566829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.567617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.569574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:36.598285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 918/1829] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:36 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:36.599459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:36.610744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea9db4-d4a5-4dc6-af14-2c18b056030e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.615424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.616443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.616723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.616993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.617706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.619753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:36.641459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:36.643406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 912/1830] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:36.662054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a864661-ba7c-41ce-bad4-7621f15b1a1c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.667966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a964052-9c2a-47cb-a089-1a1ac706cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.669150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964052-9c2a-47cb-a089-1a1ac706cc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.669150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964052-9c2a-47cb-a089-1a1ac706cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.669150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964052-9c2a-47cb-a089-1a1ac706cc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.669832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a964052-9c2a-47cb-a089-1a1ac706cc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.671476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a964052-9c2a-47cb-a089-1a1ac706cc97 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:36.683003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 919/1831] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:36.687416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:36.698105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445736b-5e87-489b-b0a3-789aca1cee04 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.703100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.703809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.704580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.704580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] PATH_INFO: `/v3/projects/3c9be291666340b79b77943f0c50a66b/users/76c65d04586b4237ab0c656944bc851f/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.720675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9be291666340b79b77943f0c50a66b, user_id=76c65d04586b4237ab0c656944bc851f, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.724388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:36.743207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 913/1832] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:36 2022] PUT /identity/v3/projects/3c9be291666340b79b77943f0c50a66b/users/76c65d04586b4237ab0c656944bc851f/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:36.754694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d04b4-7576-4b31-b408-ba30db61e08f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.755102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d04b4-7576-4b31-b408-ba30db61e08f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.755454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d04b4-7576-4b31-b408-ba30db61e08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.790561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5b5d04b4-7576-4b31-b408-ba30db61e08f None None] MFA Rules not processed for user `76c65d04586b4237ab0c656944bc851f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:36.792222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5b5d04b4-7576-4b31-b408-ba30db61e08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:36.873527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 920/1833] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:36.878139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:36.984762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350b7e-de2f-4ea2-8115-54f24c5864ab admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:36.991679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:36.992299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:36.992717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:36.993155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:36.993874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:36.995907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:37.041376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 914/1834] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:36 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:37.047872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d04b4-7576-4b31-b408-ba30db61e08f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:37.063233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d04b4-7576-4b31-b408-ba30db61e08f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:37.134598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:37.135833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:37.136415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:37.136858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:37.137868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:37.140275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:37.178087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 921/1835] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:37 2022] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:37.182867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:37.208145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132fc5-1b56-4064-8a85-1572ff52c03f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:37.217427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:37.218049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:37.218874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:37.219965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:37.220998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:37.224010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:37.244677 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 915/1836] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:37.248013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:37.272224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62df11-d36a-4780-be79-26cc04fdf04c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:37.282125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:37.284564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:37.284564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:37.286550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] PATH_INFO: `/v3/projects/dd084a5136174223a7ff5826452cee23/users/6ca8f4c7f2004c0d887cb30df993ec82/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:37.317585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd084a5136174223a7ff5826452cee23, user_id=6ca8f4c7f2004c0d887cb30df993ec82, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:37.324612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:37.420423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 922/1837] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:37 2022] PUT /identity/v3/projects/dd084a5136174223a7ff5826452cee23/users/6ca8f4c7f2004c0d887cb30df993ec82/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:37.425341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:37.455656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863345e2-1a77-4161-a96e-a5428ca49067 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:37.463878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:37.623339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcf9b3-1db5-4e26-a0ed-b441337cc9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:37.623876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcf9b3-1db5-4e26-a0ed-b441337cc9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:37.624173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcf9b3-1db5-4e26-a0ed-b441337cc9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:37.624433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcf9b3-1db5-4e26-a0ed-b441337cc9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:37.625121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcf9b3-1db5-4e26-a0ed-b441337cc9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:37.626807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcf9b3-1db5-4e26-a0ed-b441337cc9f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:37.649268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 916/1838] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:37.653492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:37.671389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b943e68-f5ca-4b7c-9d16-e5358f01555b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:37.681727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:37.682529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:37.682852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:37.683196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] PATH_INFO: `/v3/projects/dd084a5136174223a7ff5826452cee23/users/6ca8f4c7f2004c0d887cb30df993ec82/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:37.685357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd084a5136174223a7ff5826452cee23, user_id=6ca8f4c7f2004c0d887cb30df993ec82, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:37.688147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:37.694673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:37.701951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 923/1839] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:37 2022] PUT /identity/v3/projects/dd084a5136174223a7ff5826452cee23/users/6ca8f4c7f2004c0d887cb30df993ec82/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:37.718331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:37.719166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:37.720627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:37.811566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] MFA Rules not processed for user `6ca8f4c7f2004c0d887cb30df993ec82`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:37.812935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:37.913806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 917/1840] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:37.924507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:37.927606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:38.014563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b88e-9a62-42ef-9469-f4cba6e808d2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:38.018717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810745-edb0-4ab3-80ef-38b4ef76ca7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:38.019491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810745-edb0-4ab3-80ef-38b4ef76ca7f service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:38.019874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810745-edb0-4ab3-80ef-38b4ef76ca7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:38.020238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810745-edb0-4ab3-80ef-38b4ef76ca7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:38.032855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810745-edb0-4ab3-80ef-38b4ef76ca7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:38.034332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810745-edb0-4ab3-80ef-38b4ef76ca7f service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:38.047543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 924/1841] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:38.109725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:38.111250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:38.124421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecf189-8ae1-4b5f-8662-f9f25340678a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:38.128495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adba6a-4fb3-44c5-84e2-ffb901443829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:38.129335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adba6a-4fb3-44c5-84e2-ffb901443829 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:38.129816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adba6a-4fb3-44c5-84e2-ffb901443829 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:38.130094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adba6a-4fb3-44c5-84e2-ffb901443829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:38.210767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adba6a-4fb3-44c5-84e2-ffb901443829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:38.215645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adba6a-4fb3-44c5-84e2-ffb901443829 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:38.241667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 918/1842] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:38.613062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f723676-e403-46c3-9989-a2ca9338b7ef None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:38.613618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f723676-e403-46c3-9989-a2ca9338b7ef None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:38.613844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f723676-e403-46c3-9989-a2ca9338b7ef None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:38.615403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 925/1843] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:37:38.629708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:38.630020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:38.630258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:38.670753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:38.672006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:38.718221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:38.811507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 919/1844] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:37:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:38.834316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f723676-e403-46c3-9989-a2ca9338b7ef None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:38.839271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6f723676-e403-46c3-9989-a2ca9338b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:38.891500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f723676-e403-46c3-9989-a2ca9338b7ef None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:38.901654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f52cfc-6041-4948-a0ef-7e3ba63f88a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:38.902311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f52cfc-6041-4948-a0ef-7e3ba63f88a8 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:38.902584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f52cfc-6041-4948-a0ef-7e3ba63f88a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:38.903476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f52cfc-6041-4948-a0ef-7e3ba63f88a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:38.914974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f52cfc-6041-4948-a0ef-7e3ba63f88a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:38.918117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f52cfc-6041-4948-a0ef-7e3ba63f88a8 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:38.945006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 926/1845] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:41.468538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:41.470715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:41.573186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23831a-12c2-4a1a-856b-ad1fd16d56a1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:41.579274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:41.580167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:41.580449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:41.580723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] PATH_INFO: `/v3/users/e4f0497f299b43889a71e428c1e3a941` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:41.581913 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f0497f299b43889a71e428c1e3a941)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:41.584257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:41.645969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f0497f299b43889a71e428c1e3a941'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.646756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f0497f299b43889a71e428c1e3a941'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.654167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f0497f299b43889a71e428c1e3a941'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.662741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f0497f299b43889a71e428c1e3a941'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.663381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f0497f299b43889a71e428c1e3a941'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.684087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 920/1846] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:41 2022] DELETE /identity/v3/users/e4f0497f299b43889a71e428c1e3a941 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:41.688936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:41.689430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:41.689522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:41.708550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:41.709767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:41.754902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:41.756485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:41.777244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 927/1847] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:41.783195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:41.785518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:41.807534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:41.836883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f92c3-a38f-48a8-8dc9-507a27f7a488 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:41.841947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:41.842604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:41.843778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:41.844064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] PATH_INFO: `/v3/users/76c65d04586b4237ab0c656944bc851f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:41.845259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c65d04586b4237ab0c656944bc851f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:41.847879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:41.884103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213ebb1-eaed-4267-aa15-e19fa274da93 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:41.898722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1347f1-8916-4b75-91be-57e0b298c534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:41.899469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1347f1-8916-4b75-91be-57e0b298c534 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:41.899830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1347f1-8916-4b75-91be-57e0b298c534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:41.901368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1347f1-8916-4b75-91be-57e0b298c534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:41.924286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c65d04586b4237ab0c656944bc851f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.925452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c65d04586b4237ab0c656944bc851f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.925731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1347f1-8916-4b75-91be-57e0b298c534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:41.927236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1347f1-8916-4b75-91be-57e0b298c534 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:41.940602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 928/1848] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:41.961411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c65d04586b4237ab0c656944bc851f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.988637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c65d04586b4237ab0c656944bc851f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:41.989473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c65d04586b4237ab0c656944bc851f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.013896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 921/1849] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:41 2022] DELETE /identity/v3/users/76c65d04586b4237ab0c656944bc851f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:42.018323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.018707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.019535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.060134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:42.065005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.098961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:42.159459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 929/1850] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:42.166556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:42.169492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.235034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aecbca-961b-4875-a890-884762d55737 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:42.238815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0cc3e-da9f-42a1-abda-f8200de185df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:42.240019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0cc3e-da9f-42a1-abda-f8200de185df service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.240300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0cc3e-da9f-42a1-abda-f8200de185df service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.240579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0cc3e-da9f-42a1-abda-f8200de185df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.252151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0cc3e-da9f-42a1-abda-f8200de185df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:42.253639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0cc3e-da9f-42a1-abda-f8200de185df service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:42.267125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 922/1851] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:42.430389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:42.432429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.451574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07f3af-5532-4941-8b97-82a965a8e1f0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:42.465779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:42.466531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.466881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.467231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] PATH_INFO: `/v3/projects/105ea78a84bd4855bacc9272607d60b8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.469296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105ea78a84bd4855bacc9272607d60b8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:42.471534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:42.555165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105ea78a84bd4855bacc9272607d60b8', 'request_id': 'req-b22490dc-81fc-4ca8-96a4-30536f1198c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.561771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105ea78a84bd4855bacc9272607d60b8', 'request_id': 'req-b22490dc-81fc-4ca8-96a4-30536f1198c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.569723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105ea78a84bd4855bacc9272607d60b8', 'request_id': 'req-b22490dc-81fc-4ca8-96a4-30536f1198c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.585017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] The token cache is being invalidate because project 105ea78a84bd4855bacc9272607d60b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:42.585357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.586049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b22490dc-81fc-4ca8-96a4-30536f1198c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.587912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 930/1852] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:42 2022] DELETE /identity/v3/projects/105ea78a84bd4855bacc9272607d60b8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:42.592576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.593055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.593129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.612323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:42.613532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.672243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:42.687408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 923/1853] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:42.696780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddf34d-a4d0-4df2-afaa-e0ef3b3b9881 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.697867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddf34d-a4d0-4df2-afaa-e0ef3b3b9881 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.698353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddf34d-a4d0-4df2-afaa-e0ef3b3b9881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.700545 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:42.702573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.724020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb19d5-d117-4829-a37c-f07a2f3457c9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:42.728685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-61ddf34d-a4d0-4df2-afaa-e0ef3b3b9881 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:42.730382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-61ddf34d-a4d0-4df2-afaa-e0ef3b3b9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.738990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:42.739673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.739951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.740248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] PATH_INFO: `/v3/projects/3c9be291666340b79b77943f0c50a66b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.741833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9be291666340b79b77943f0c50a66b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:42.743810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:42.745155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 931/1854] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:42.749399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddf34d-a4d0-4df2-afaa-e0ef3b3b9881 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:42.759477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddf34d-a4d0-4df2-afaa-e0ef3b3b9881 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:42.764586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:42.765534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.766092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.766624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.767448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:42.767921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:42.769723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:42.782793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 932/1855] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:42.787055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:42.797259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5e81-69b8-4ba0-993c-d3a61f5de6ae admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:42.803407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9be291666340b79b77943f0c50a66b', 'request_id': 'req-59705360-9778-41c9-bf3b-0a4f27cc22bb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.812787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9be291666340b79b77943f0c50a66b', 'request_id': 'req-59705360-9778-41c9-bf3b-0a4f27cc22bb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.822365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9be291666340b79b77943f0c50a66b', 'request_id': 'req-59705360-9778-41c9-bf3b-0a4f27cc22bb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.838734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] The token cache is being invalidate because project 3c9be291666340b79b77943f0c50a66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:42.839239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.839995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:42.841614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 924/1856] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:42 2022] DELETE /identity/v3/projects/3c9be291666340b79b77943f0c50a66b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:42.846119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:42.847529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.864949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:42.865419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:42.866215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:42.866493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:42.867397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:42.869882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:42.909026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 933/1857] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:42 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:42.913062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:42.914875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:42.927417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59705360-9778-41c9-bf3b-0a4f27cc22bb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:42.936958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:43.001076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3759a3-3ec4-4fe5-9509-f96f4db05269 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.004192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.004952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.006070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.006534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] PATH_INFO: `/v3/users/6ca8f4c7f2004c0d887cb30df993ec82` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.007070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.008250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.008730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.008837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca8f4c7f2004c0d887cb30df993ec82)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.009433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.010195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.011461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.012473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.046960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 934/1858] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:42 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:43.047971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:43.060427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7d5f0-1d90-422c-b3d0-7ba3a3d77f18 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.063884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:43.066935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.068763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.069047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.069316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.070024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.072873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.085818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca8f4c7f2004c0d887cb30df993ec82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:43.086980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 935/1859] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:43.087380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca8f4c7f2004c0d887cb30df993ec82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:43.091355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:43.097500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca8f4c7f2004c0d887cb30df993ec82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:43.104194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6a546-343e-45fb-a243-580ae103293e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.110265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca8f4c7f2004c0d887cb30df993ec82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:43.110971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-801e1c04-5123-4ac0-80a2-406f7ec4c521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca8f4c7f2004c0d887cb30df993ec82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:43.114554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.115164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.115439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.116019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.117143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.118273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.149446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 936/1860] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:43.149694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 925/1861] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:42 2022] DELETE /identity/v3/users/6ca8f4c7f2004c0d887cb30df993ec82 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:43.151151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:43.153332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:43.168526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3152a-7ae6-4a2c-9467-1071dd1cb9f1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.256604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.257834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.258289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.258903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] PATH_INFO: `/v3/projects/de98294de0c94f1b9fc218aed1dbf17a/users/e9324dea4d9a4ef0b5de374aec5870ee/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.280562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=de98294de0c94f1b9fc218aed1dbf17a, user_id=e9324dea4d9a4ef0b5de374aec5870ee, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.284430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.316474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 937/1862] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:43 2022] PUT /identity/v3/projects/de98294de0c94f1b9fc218aed1dbf17a/users/e9324dea4d9a4ef0b5de374aec5870ee/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:43.327950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3a881-709e-4bfd-814e-2661bedc4900 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.328137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3a881-709e-4bfd-814e-2661bedc4900 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.328414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3a881-709e-4bfd-814e-2661bedc4900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.407564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5db3a881-709e-4bfd-814e-2661bedc4900 None None] MFA Rules not processed for user `e9324dea4d9a4ef0b5de374aec5870ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:43.409335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5db3a881-709e-4bfd-814e-2661bedc4900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:43.537762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 926/1863] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:43.541961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:43.638328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98d804-2f10-4b3a-a6c7-988bc9edd0ca admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.645349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.646001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.646275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.646539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.647173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.649274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.669420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:43.696179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 938/1864] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:43 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:43.698370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3a881-709e-4bfd-814e-2661bedc4900 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:43.719688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3a881-709e-4bfd-814e-2661bedc4900 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.733500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:43.736701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:43.849695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.851227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.851902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.852676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.854428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.859943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.905910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57fea-c1b9-4226-aab3-a27efa6f1c6a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.910938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 927/1865] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:43 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:43.914444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:43.916965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.920016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.920482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.920928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] PATH_INFO: `/v3/projects/dd084a5136174223a7ff5826452cee23` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.923959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd084a5136174223a7ff5826452cee23)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.929524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:43.935023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b1b7-14e0-4c83-8991-904b8668f950 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:43.948248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:43.949687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:43.950603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:43.951756 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:43.952676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:43.954723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.014575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 928/1866] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:44.019618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.039686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd084a5136174223a7ff5826452cee23', 'request_id': 'req-c1a5f5af-2c04-4e14-9662-58ff039b7045'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:44.043050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfd64-3cb3-4268-ba67-dd7e15471df0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.056758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd084a5136174223a7ff5826452cee23', 'request_id': 'req-c1a5f5af-2c04-4e14-9662-58ff039b7045'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:44.073070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd084a5136174223a7ff5826452cee23', 'request_id': 'req-c1a5f5af-2c04-4e14-9662-58ff039b7045'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:44.082752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:44.101773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] The token cache is being invalidate because project dd084a5136174223a7ff5826452cee23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:44.101999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:44.102797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c1a5f5af-2c04-4e14-9662-58ff039b7045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:44.105836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 939/1867] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:43 2022] DELETE /identity/v3/projects/dd084a5136174223a7ff5826452cee23 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:44.111050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feefa3-36a3-45a0-bb57-489309d8d9b8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.111301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feefa3-36a3-45a0-bb57-489309d8d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.111793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feefa3-36a3-45a0-bb57-489309d8d9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.166206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-14feefa3-36a3-45a0-bb57-489309d8d9b8 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:44.166206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-14feefa3-36a3-45a0-bb57-489309d8d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:44.209086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.209826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.210737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.210737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.211321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.215024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.230262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 929/1868] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:44.231664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.241365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:44.267182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515a444-ef8c-451e-9921-0c709cad719b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.277974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5a9f0-715e-43f9-a387-1a8a8212af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.278585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 940/1869] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:44.288016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5a9f0-715e-43f9-a387-1a8a8212af00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.288310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5a9f0-715e-43f9-a387-1a8a8212af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.289282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5a9f0-715e-43f9-a387-1a8a8212af00 admin admin] PATH_INFO: `/v3/projects/8f98a1eabbf94131b0cbfa55b1fadd51/users/0e55b898da5747beaa12f19eaf0703d3/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.289403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49c9f5-0b59-4bac-8134-8109a63e7375 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.290333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49c9f5-0b59-4bac-8134-8109a63e7375 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.290772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49c9f5-0b59-4bac-8134-8109a63e7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.336902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5a9f0-715e-43f9-a387-1a8a8212af00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f98a1eabbf94131b0cbfa55b1fadd51, user_id=0e55b898da5747beaa12f19eaf0703d3, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.339878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-af49c9f5-0b59-4bac-8134-8109a63e7375 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:44.340925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5a9f0-715e-43f9-a387-1a8a8212af00 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.342386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-af49c9f5-0b59-4bac-8134-8109a63e7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:44.359170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 941/1870] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:44.360589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49c9f5-0b59-4bac-8134-8109a63e7375 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.374838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49c9f5-0b59-4bac-8134-8109a63e7375 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.393227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 930/1871] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:44 2022] PUT /identity/v3/projects/8f98a1eabbf94131b0cbfa55b1fadd51/users/0e55b898da5747beaa12f19eaf0703d3/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:44.401202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe715ef-dcf9-4ece-b1fb-8afe4c17a792 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.401567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe715ef-dcf9-4ece-b1fb-8afe4c17a792 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.403127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe715ef-dcf9-4ece-b1fb-8afe4c17a792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.410005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:44.457049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7fe715ef-dcf9-4ece-b1fb-8afe4c17a792 None None] MFA Rules not processed for user `0e55b898da5747beaa12f19eaf0703d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:44.458312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7fe715ef-dcf9-4ece-b1fb-8afe4c17a792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:44.491959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.493244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.493931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.494475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.495392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:44.495943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.499250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.543768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 942/1872] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:44.546437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.574048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacfe51-886e-47eb-a787-354db7953da3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.581321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 931/1873] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:44.586477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe715ef-dcf9-4ece-b1fb-8afe4c17a792 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.589969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.591280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.591280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.591450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.592073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.594852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.613056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe715ef-dcf9-4ece-b1fb-8afe4c17a792 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.620030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.620877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.621152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.621418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.622088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.624005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.655410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 943/1874] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:44 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:44.659375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.694102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 932/1875] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:44 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:44.699320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.756672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9909e5-0125-40ea-babe-abed1228b2ea admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.788727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:44.792899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497908d-b421-4730-8d9d-c2bbfff9636a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.801987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.802609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.802939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.803190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.804317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.806867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.826388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.827018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.827297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.827566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.828205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.832398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 933/1876] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:44 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:44.832524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.834189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.844989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc857b-7c3b-488f-804a-94c45c8f63e4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.850679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.851358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.851679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.851930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.852872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.854526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.859183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 944/1877] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:44 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:44.863547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.870630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 934/1878] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:44.880209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a431d-f796-4b1e-808c-ed02c5f48d06 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.880407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.886371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.887755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.888148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.888870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.889498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.891079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfefc49-d44b-4d62-a5e6-7dfebbbbe823 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.891492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.896648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.897564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.897866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.898166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] PATH_INFO: `/v3/projects/f568409f5f7d454f93ff509e2fdbee39/users/ea37b365d3ea43699ffe7dd8d6d15988/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.904518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 945/1879] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:44.908554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.917769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f568409f5f7d454f93ff509e2fdbee39, user_id=ea37b365d3ea43699ffe7dd8d6d15988, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.920642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c7cc-0806-4019-be7f-c2bc9c52dfb9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.921139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.926504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:44.927263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:44.927533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:44.927894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:44.928998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:44.930925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:44.940457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 935/1880] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:44 2022] PUT /identity/v3/projects/f568409f5f7d454f93ff509e2fdbee39/users/ea37b365d3ea43699ffe7dd8d6d15988/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:44.944366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.945645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 946/1881] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:44.946426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:44.957676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d791-2a08-4d0a-a368-16e695b8b1ac admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:44.962266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:45.034211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab28c8-1020-4856-a844-0e97ae161941 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.042596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.043342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.043721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.044012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.045094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.047075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.047442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e738e8d-54fa-4205-8beb-23d60b4fea2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.048188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e738e8d-54fa-4205-8beb-23d60b4fea2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.048470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e738e8d-54fa-4205-8beb-23d60b4fea2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.048741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e738e8d-54fa-4205-8beb-23d60b4fea2f admin admin] PATH_INFO: `/v3/projects/1b93bf83956f4c66bc0fd350cca3c3b8/users/d17913642fc24de3a113d6efd8d42f0a/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.065322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e738e8d-54fa-4205-8beb-23d60b4fea2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b93bf83956f4c66bc0fd350cca3c3b8, user_id=d17913642fc24de3a113d6efd8d42f0a, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.068098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e738e8d-54fa-4205-8beb-23d60b4fea2f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.069356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 936/1882] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:45.070374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.082443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c4a7-9400-45aa-82bb-b1fa69d5979b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.087236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 947/1883] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:44 2022] PUT /identity/v3/projects/1b93bf83956f4c66bc0fd350cca3c3b8/users/d17913642fc24de3a113d6efd8d42f0a/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:45.098004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c877-4a0f-43b8-a33f-a343ffefc211 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.098315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c877-4a0f-43b8-a33f-a343ffefc211 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.098587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c877-4a0f-43b8-a33f-a343ffefc211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.129943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7598c877-4a0f-43b8-a33f-a343ffefc211 None None] MFA Rules not processed for user `d17913642fc24de3a113d6efd8d42f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:45.131181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7598c877-4a0f-43b8-a33f-a343ffefc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:45.155587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8197b-ffb0-4848-aefa-00dedd83c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.156657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8197b-ffb0-4848-aefa-00dedd83c9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.157467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8197b-ffb0-4848-aefa-00dedd83c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.157950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8197b-ffb0-4848-aefa-00dedd83c9e9 admin admin] PATH_INFO: `/v3/projects/f568409f5f7d454f93ff509e2fdbee39/users/ea37b365d3ea43699ffe7dd8d6d15988/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.160144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8197b-ffb0-4848-aefa-00dedd83c9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f568409f5f7d454f93ff509e2fdbee39, user_id=ea37b365d3ea43699ffe7dd8d6d15988, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.164482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8197b-ffb0-4848-aefa-00dedd83c9e9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.189303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 937/1884] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:45 2022] PUT /identity/v3/projects/f568409f5f7d454f93ff509e2fdbee39/users/ea37b365d3ea43699ffe7dd8d6d15988/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:45.200809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.201182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.201619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.236005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] MFA Rules not processed for user `ea37b365d3ea43699ffe7dd8d6d15988`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:45.237359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 948/1885] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:45.237615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:45.242283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c877-4a0f-43b8-a33f-a343ffefc211 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.259493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c877-4a0f-43b8-a33f-a343ffefc211 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.294494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:45.351226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.352249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.352619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.353035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.354052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.356279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.358477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 938/1886] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:45.375532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.379391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:45.416298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 949/1887] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:45 2022] POST /identity/v3/projects => generated 401 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:45.420600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.427665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:45.464139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096cedd-e209-40ec-8529-62aad529c479 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.521448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0a9ce-b59b-4f94-b1b5-8dc9a0db2111 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.528219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.528850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.529129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.529403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.530855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.532930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.537959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.538778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.539116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.539452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.545046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:45.558578 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 950/1888] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:45 2022] POST /identity/v3/users => generated 307 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:45.562396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.572689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecec9c-83e3-4b71-b6a7-6c256eda7d08 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.578062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.578892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.579254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.579743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.580711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.582786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.595410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 951/1889] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:45.599671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.611945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80474c37-bd76-4af5-a0e4-4c9a98a87c00 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.618498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.619267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.619514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.619768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] PATH_INFO: `/v3/projects/65436bb4856747069320060845a9ef2c/users/1514e0adf8a74e4fb2b6223f70728565/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.628120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.630128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.639154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65436bb4856747069320060845a9ef2c, user_id=1514e0adf8a74e4fb2b6223f70728565, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.642016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.642500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 939/1890] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:45.666882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 952/1891] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:45 2022] PUT /identity/v3/projects/65436bb4856747069320060845a9ef2c/users/1514e0adf8a74e4fb2b6223f70728565/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:45.668165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.688386 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8004991-4f8f-49e2-a9bb-1da2297abd93 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.773429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:45.824456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed8f16-1ff5-421a-bcd1-40c902e7a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.824906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8f16-1ff5-421a-bcd1-40c902e7a5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.825182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8f16-1ff5-421a-bcd1-40c902e7a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.825448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8f16-1ff5-421a-bcd1-40c902e7a5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.826141 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed8f16-1ff5-421a-bcd1-40c902e7a5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.827757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed8f16-1ff5-421a-bcd1-40c902e7a5e8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.855046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 940/1892] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:45.858682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:45.878978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cd21-8c34-4e93-9bd2-07416a455964 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:45.886176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:45.887446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.887976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.888444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] PATH_INFO: `/v3/projects/65436bb4856747069320060845a9ef2c/users/1514e0adf8a74e4fb2b6223f70728565/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.892147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65436bb4856747069320060845a9ef2c, user_id=1514e0adf8a74e4fb2b6223f70728565, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:45.895223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:45.913324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 953/1893] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:45 2022] PUT /identity/v3/projects/65436bb4856747069320060845a9ef2c/users/1514e0adf8a74e4fb2b6223f70728565/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:45.924613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a6eab-2e6c-4ce2-a9d4-20ea5dcd0b8b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:45.925032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a6eab-2e6c-4ce2-a9d4-20ea5dcd0b8b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:45.925309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a6eab-2e6c-4ce2-a9d4-20ea5dcd0b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:45.968704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-974a6eab-2e6c-4ce2-a9d4-20ea5dcd0b8b None None] MFA Rules not processed for user `1514e0adf8a74e4fb2b6223f70728565`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:45.970854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-974a6eab-2e6c-4ce2-a9d4-20ea5dcd0b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:46.075908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 941/1894] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:46.085041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:46.088009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:46.196654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479934f-cb29-49d0-a915-6cc48b131648 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:46.202604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:46.204083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:46.205840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:46.206311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:46.221017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:46.222958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:46.245154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 954/1895] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:46 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:46.424109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a6eab-2e6c-4ce2-a9d4-20ea5dcd0b8b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:46.440473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a6eab-2e6c-4ce2-a9d4-20ea5dcd0b8b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:46.452873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:46.453524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:46.453979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:46.454164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:46.556568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:46.562655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:46.588034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 942/1896] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:47.629809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:47.641127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b804-9b3f-49f1-8731-d05695488dee service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:47.645455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:47.646294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:47.646573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:47.646841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:47.703169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:47.723238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:47.724964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:47.742931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 955/1897] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:48.559696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:48.570425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9520a8-4911-48ea-96f0-a1b5231aab52 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:48.574723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:48.575377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:48.575664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:48.575956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:48.644740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:48.657191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:48.659285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:48.673096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 943/1898] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:37:50.656873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:50.751643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519be4a-b46e-4bc7-bbb9-5fa33315c3db service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:50.756637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:50.757272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:50.757575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:50.757860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] PATH_INFO: `/v3/users/d17913642fc24de3a113d6efd8d42f0a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:50.759048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17913642fc24de3a113d6efd8d42f0a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:50.760985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:50.811697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:50.813132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:50.815780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17913642fc24de3a113d6efd8d42f0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.828715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77bc14-8b41-4f25-a111-b9c22cbad1d9 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:50.829301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17913642fc24de3a113d6efd8d42f0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.833297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:50.833965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:50.834244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:50.834517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] PATH_INFO: `/v3/users/2d470f7ff8a64e5ab283216dca9d7bb2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:50.835638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d470f7ff8a64e5ab283216dca9d7bb2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:50.836354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17913642fc24de3a113d6efd8d42f0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.837111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17913642fc24de3a113d6efd8d42f0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.837664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:50.837760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce7fc672-ae6f-43ed-abf4-84da896c6036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17913642fc24de3a113d6efd8d42f0a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.852816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 956/1899] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:50 2022] DELETE /identity/v3/users/d17913642fc24de3a113d6efd8d42f0a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:50.857438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754672-3bea-40fb-afe6-53426736976f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:50.857771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754672-3bea-40fb-afe6-53426736976f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:50.858045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25754672-3bea-40fb-afe6-53426736976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:50.879833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-25754672-3bea-40fb-afe6-53426736976f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:50.881194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-25754672-3bea-40fb-afe6-53426736976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:50.891391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d470f7ff8a64e5ab283216dca9d7bb2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.892049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d470f7ff8a64e5ab283216dca9d7bb2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.899105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d470f7ff8a64e5ab283216dca9d7bb2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.907400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d470f7ff8a64e5ab283216dca9d7bb2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.907914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4c670332-6b19-4cb1-9783-1085bd81bf02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d470f7ff8a64e5ab283216dca9d7bb2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:50.925782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 944/1900] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:50 2022] DELETE /identity/v3/users/2d470f7ff8a64e5ab283216dca9d7bb2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:50.930145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:50.930480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:50.930811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:50.940671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 957/1901] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:50.950420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25754672-3bea-40fb-afe6-53426736976f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:50.951610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:50.951762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-25754672-3bea-40fb-afe6-53426736976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:50.952797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:50.973684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:51.042789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 945/1902] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:51.045091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25754672-3bea-40fb-afe6-53426736976f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:51.055199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:51.056631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:51.119686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:51.120585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:51.120971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:51.121343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:51.143943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:51.146220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:51.162832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 958/1903] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:37:51.164714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11415a4-fcd5-4b23-9340-715d3b28f11a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:51.169084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:51.169727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:51.170047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:51.170316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:51.182248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:51.183711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:51.195983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 946/1904] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:37:51.599186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:51.600845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:51.602383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:51.608079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:51.639539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb506eb7-1b2c-413e-89ce-2ca4a73bd698 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:51.642474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73c645-d7f3-4129-8dc5-34baa61ec382 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:51.673127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:51.673725 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:51.674006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:51.674272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] PATH_INFO: `/v3/projects/fac54c1511104f3aa42e47566a4a89fd` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:51.676270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:51.676911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:51.678107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:51.678107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] PATH_INFO: `/v3/projects/1b93bf83956f4c66bc0fd350cca3c3b8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:51.681762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac54c1511104f3aa42e47566a4a89fd)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:51.683746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:51.689166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b93bf83956f4c66bc0fd350cca3c3b8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:51.691163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:51.706238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:51.786712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b93bf83956f4c66bc0fd350cca3c3b8', 'request_id': 'req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.797080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b93bf83956f4c66bc0fd350cca3c3b8', 'request_id': 'req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.798143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac54c1511104f3aa42e47566a4a89fd', 'request_id': 'req-edea3095-3605-4f8e-8408-1871dea5a225'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.810524 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b93bf83956f4c66bc0fd350cca3c3b8', 'request_id': 'req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.815051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac54c1511104f3aa42e47566a4a89fd', 'request_id': 'req-edea3095-3605-4f8e-8408-1871dea5a225'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.823054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac54c1511104f3aa42e47566a4a89fd', 'request_id': 'req-edea3095-3605-4f8e-8408-1871dea5a225'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.826942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] The token cache is being invalidate because project 1b93bf83956f4c66bc0fd350cca3c3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:51.827776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.828996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.831250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 947/1905] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:51 2022] DELETE /identity/v3/projects/1b93bf83956f4c66bc0fd350cca3c3b8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:51.834974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:51.836355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:51.839090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] The token cache is being invalidate because project fac54c1511104f3aa42e47566a4a89fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:51.839445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.840065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:51.843138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 959/1906] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:51 2022] DELETE /identity/v3/projects/fac54c1511104f3aa42e47566a4a89fd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:51.847173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:51.848776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:51.908950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:51.929361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998fc45-7fd9-4ff6-9018-8ff4ceba9c46 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:51.933880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3095-3605-4f8e-8408-1871dea5a225 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:51.935274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:51.936159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:51.936748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:51.937028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] PATH_INFO: `/v3/users/1514e0adf8a74e4fb2b6223f70728565` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:51.938205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=1514e0adf8a74e4fb2b6223f70728565)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:51.940140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:51.941893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:51.942478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:51.943256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:51.943385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] PATH_INFO: `/v3/users/6650698718c04c619f5bd24a104231c3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:51.944634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6650698718c04c619f5bd24a104231c3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:51.947692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:52.003645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1514e0adf8a74e4fb2b6223f70728565'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.006872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1514e0adf8a74e4fb2b6223f70728565'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.021732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1514e0adf8a74e4fb2b6223f70728565'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.033176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1514e0adf8a74e4fb2b6223f70728565'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.033943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1514e0adf8a74e4fb2b6223f70728565'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.050966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6650698718c04c619f5bd24a104231c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.063999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 948/1907] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:51 2022] DELETE /identity/v3/users/1514e0adf8a74e4fb2b6223f70728565 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:52.065279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6650698718c04c619f5bd24a104231c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.074337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6650698718c04c619f5bd24a104231c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.075151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6650698718c04c619f5bd24a104231c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.075836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6650698718c04c619f5bd24a104231c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.099918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 960/1908] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:51 2022] DELETE /identity/v3/users/6650698718c04c619f5bd24a104231c3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:52.518656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:52.520133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:52.532119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:52.572075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:52.574032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:52.625972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9a29a-cf22-4d79-90f7-e38cb568b2df admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:52.657530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7c217-108a-48e6-885f-514310fa0915 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:52.662522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:52.663166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.663447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.663719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] PATH_INFO: `/v3/projects/c8e3bd3ee87a43c198cff97bdfab7d0e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.665634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e3bd3ee87a43c198cff97bdfab7d0e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:52.667122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:52.693538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:52.694484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.694768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.695043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] PATH_INFO: `/v3/projects/65436bb4856747069320060845a9ef2c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.696352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=65436bb4856747069320060845a9ef2c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:52.698332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:52.738367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e3bd3ee87a43c198cff97bdfab7d0e', 'request_id': 'req-cd6b6c69-d504-4791-bf17-3c61448a073d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.745257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e3bd3ee87a43c198cff97bdfab7d0e', 'request_id': 'req-cd6b6c69-d504-4791-bf17-3c61448a073d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.751268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e3bd3ee87a43c198cff97bdfab7d0e', 'request_id': 'req-cd6b6c69-d504-4791-bf17-3c61448a073d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.763548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:52.763653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65436bb4856747069320060845a9ef2c', 'request_id': 'req-cd44b667-f3f9-4f80-90e5-409209dae6aa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.771222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65436bb4856747069320060845a9ef2c', 'request_id': 'req-cd44b667-f3f9-4f80-90e5-409209dae6aa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.777566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] The token cache is being invalidate because project c8e3bd3ee87a43c198cff97bdfab7d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:52.777978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.782992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd6b6c69-d504-4791-bf17-3c61448a073d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.788458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 961/1909] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:52 2022] DELETE /identity/v3/projects/c8e3bd3ee87a43c198cff97bdfab7d0e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:52.790496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c3406-7faa-46d0-aca7-2ce70e685bfd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.790842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c3406-7faa-46d0-aca7-2ce70e685bfd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.791293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c3406-7faa-46d0-aca7-2ce70e685bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.793564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65436bb4856747069320060845a9ef2c', 'request_id': 'req-cd44b667-f3f9-4f80-90e5-409209dae6aa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.808743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] The token cache is being invalidate because project 65436bb4856747069320060845a9ef2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:52.809239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.809942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd44b667-f3f9-4f80-90e5-409209dae6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:52.811690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 949/1910] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:52 2022] DELETE /identity/v3/projects/65436bb4856747069320060845a9ef2c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:52.812079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-179c3406-7faa-46d0-aca7-2ce70e685bfd None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:52.813259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-179c3406-7faa-46d0-aca7-2ce70e685bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:52.816228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f20a0-ff35-40ab-8c8f-b62f7d75f6fb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.816455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f20a0-ff35-40ab-8c8f-b62f7d75f6fb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.816728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f20a0-ff35-40ab-8c8f-b62f7d75f6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.837166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-729f20a0-ff35-40ab-8c8f-b62f7d75f6fb None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:52.838424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-729f20a0-ff35-40ab-8c8f-b62f7d75f6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:52.874456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 962/1911] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:52.882914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700fe1b-1d67-4a1c-845c-d1352360c63f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.883270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700fe1b-1d67-4a1c-845c-d1352360c63f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.883552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700fe1b-1d67-4a1c-845c-d1352360c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.884396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:52.903895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 950/1912] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:52.905620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6700fe1b-1d67-4a1c-845c-d1352360c63f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:52.906893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6700fe1b-1d67-4a1c-845c-d1352360c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:52.911531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121afa-f1b7-4261-9a22-434c4a0c541d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.911808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121afa-f1b7-4261-9a22-434c4a0c541d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.912081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121afa-f1b7-4261-9a22-434c4a0c541d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.914974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 963/1913] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:52.919240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700fe1b-1d67-4a1c-845c-d1352360c63f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:52.929076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700fe1b-1d67-4a1c-845c-d1352360c63f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:52.934008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:52.934580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ab121afa-f1b7-4261-9a22-434c4a0c541d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:52.934719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.934877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.935145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.935773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ab121afa-f1b7-4261-9a22-434c4a0c541d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:52.935873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:52.936077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:52.937703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:52.943699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 951/1914] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:52.948241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab121afa-f1b7-4261-9a22-434c4a0c541d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:52.950242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 964/1915] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:37:52.954801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:52.957693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab121afa-f1b7-4261-9a22-434c4a0c541d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:52.962608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:52.963119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.963401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.963675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.964325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:52.964623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:52.964931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536aeec-78aa-4d27-af48-5f8c67c8a4f8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:52.966289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:52.970215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:52.970801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.971078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.971345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:52.972000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:52.973904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:52.978047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 952/1916] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:37:52.982622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:52.993052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1928ca-fadb-4b59-8729-9a353d6125fc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:52.998751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:52.999345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:52.999629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:52.999884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.000521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.002541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.002858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 965/1917] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:52 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:53.007591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.034915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 953/1918] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:52 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:53.035972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.072343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2a848-58a0-4481-8bc3-cc143de1bb19 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.096921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f346b-37d7-42de-abdc-b5415c481edd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.101569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.102181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.102458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.102768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.103544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.105470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.128378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 954/1919] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:53.130022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.130635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.130914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.131254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.131939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.132411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.134115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.142202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a8440-3aac-4363-b6e2-c44764211d6c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.144294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:53.147316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.147889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.148169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.148446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.149112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.150878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.161651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 966/1920] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:53.161818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 955/1921] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:53.165040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.165150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.174770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd238d18-2d3d-46fb-b083-c52249d7f11b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.175093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac0213-abc6-46a0-b775-e0d675ff5adf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.179423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.179727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.179999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.180293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.180384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.180556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.180713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.180875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.181229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.181505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.182929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.183221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.193991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 967/1922] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:53.198324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 956/1923] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:53.201899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.202519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.213692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a23a1-f962-4a6d-b585-063699f54f9b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.216900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221cec1-7932-4d69-afed-63e4f5fce13a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.219547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.220148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.220425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.220729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.221385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.222220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.223602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.223738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.223738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.223738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] PATH_INFO: `/v3/projects/1ba720656fbf45d7b1b1f3e46c82bc5e/users/0386e802908f4d7aa385f523807588a7/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.235039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 957/1924] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:53.238479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.245457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba720656fbf45d7b1b1f3e46c82bc5e, user_id=0386e802908f4d7aa385f523807588a7, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.249141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.250079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed0c65-d2a1-4455-be37-a3f5689b3e70 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.255214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19731-d55d-4711-bd8c-bb4bf6abcf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.255941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19731-d55d-4711-bd8c-bb4bf6abcf84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.256367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19731-d55d-4711-bd8c-bb4bf6abcf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.256692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19731-d55d-4711-bd8c-bb4bf6abcf84 admin admin] PATH_INFO: `/v3/projects/09b529d1c1bd47e595f9ce2b13cdb747/users/9858f9e1f1724cad9de2fa7ec2e882c3/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.267332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 968/1925] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:53 2022] PUT /identity/v3/projects/1ba720656fbf45d7b1b1f3e46c82bc5e/users/0386e802908f4d7aa385f523807588a7/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:53.277473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.280256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:53.284985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f19731-d55d-4711-bd8c-bb4bf6abcf84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b529d1c1bd47e595f9ce2b13cdb747, user_id=9858f9e1f1724cad9de2fa7ec2e882c3, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.287779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f19731-d55d-4711-bd8c-bb4bf6abcf84 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.310849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 958/1926] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:53 2022] PUT /identity/v3/projects/09b529d1c1bd47e595f9ce2b13cdb747/users/9858f9e1f1724cad9de2fa7ec2e882c3/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:53.310849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e34672-9fc2-4942-8aab-c0d6d33275d4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.310849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e34672-9fc2-4942-8aab-c0d6d33275d4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.310849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e34672-9fc2-4942-8aab-c0d6d33275d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.332242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-33e34672-9fc2-4942-8aab-c0d6d33275d4 None None] MFA Rules not processed for user `0386e802908f4d7aa385f523807588a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:53.333612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-33e34672-9fc2-4942-8aab-c0d6d33275d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:53.360797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:53.364671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5197-1363-4726-bb6a-54917ce32dc4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.434816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 959/1927] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:53.436249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849c53-832f-498b-93c1-635f821b580a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.436670 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849c53-832f-498b-93c1-635f821b580a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.437429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849c53-832f-498b-93c1-635f821b580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.456897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.457576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.457871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.458144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] PATH_INFO: `/v3/users/e9324dea4d9a4ef0b5de374aec5870ee` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.459270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9324dea4d9a4ef0b5de374aec5870ee)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.461194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.468812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-63849c53-832f-498b-93c1-635f821b580a None None] MFA Rules not processed for user `9858f9e1f1724cad9de2fa7ec2e882c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:53.470268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63849c53-832f-498b-93c1-635f821b580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:53.530594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9324dea4d9a4ef0b5de374aec5870ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:53.548172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9324dea4d9a4ef0b5de374aec5870ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:53.552735 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:53.555243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 960/1928] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:53.556350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849c53-832f-498b-93c1-635f821b580a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.558715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9324dea4d9a4ef0b5de374aec5870ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:53.560317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9324dea4d9a4ef0b5de374aec5870ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:53.561288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9324dea4d9a4ef0b5de374aec5870ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:53.570011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849c53-832f-498b-93c1-635f821b580a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.575476 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63ee4e-7e83-4099-a4b2-dd3c0f064925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.576115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63ee4e-7e83-4099-a4b2-dd3c0f064925 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.576550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63ee4e-7e83-4099-a4b2-dd3c0f064925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.576822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63ee4e-7e83-4099-a4b2-dd3c0f064925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.576972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 969/1929] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:53 2022] DELETE /identity/v3/users/e9324dea4d9a4ef0b5de374aec5870ee => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:53.577667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63ee4e-7e83-4099-a4b2-dd3c0f064925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.579573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63ee4e-7e83-4099-a4b2-dd3c0f064925 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.580833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.582197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:53.610418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 961/1930] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:53.614807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.615094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.615370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.635648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:53.636863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:53.654937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426822-ee7d-4d73-9a95-2e66d307ed99 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.700348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 962/1931] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:53.702448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.703812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:53.710516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.711202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.711476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.711740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.712438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.714392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.716151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a3b7d-8b53-4fc4-9839-172b67a5e6d2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.720825 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.721423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.721741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.722020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.722650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.724561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.742682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 970/1932] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:53.743901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.745884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:53.749680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 963/1933] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:53.749680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.758718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afbc45-fc01-49c9-9f5f-96973d01d1d4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.771431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:53.808196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0bff7-dcf5-44f3-bc71-f95324791bf4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.812085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.812702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.812980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.814617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.819929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.820536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.820812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.821077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.821791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.823708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.848245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 964/1934] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:53 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:53.849113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.851089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:53.873769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b6cee-7963-4743-a197-216229abd879 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.879714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.880321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.880618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.880891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.881976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.883632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.894978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.897069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.901339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 965/1935] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:53.902698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.910397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 971/1936] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:53.911654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.914636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80c5b-63bf-433e-8c7c-00dd118afcc3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.923159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d326a6d-c867-4dcd-988a-1881a63ba118 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.925407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.926344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.926823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.927239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.928057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.928210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.928910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.929242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.929606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.930366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:53.931744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.932211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:53.947662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 972/1937] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:53.950485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 966/1938] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:53.951318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.953715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:53.964136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce922206-bffa-4f23-a9ee-21a6158af2a3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.970472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a157a26-507e-4b86-8ce8-ab329c4483ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.971146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157a26-507e-4b86-8ce8-ab329c4483ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.971428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157a26-507e-4b86-8ce8-ab329c4483ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.971530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbddc3-4c99-41cb-8419-a91c13cd33e3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:53.971709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157a26-507e-4b86-8ce8-ab329c4483ce admin admin] PATH_INFO: `/v3/projects/9e92fc1d0530479f98bb6c2813c6f538/users/a7cfb0a20d8946c4a6970dff384c9775/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:53.979239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:53.979919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:53.980204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:53.980633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] PATH_INFO: `/v3/projects/b1387d8e0aa04724abe5004e77d47ca9/users/3c149b035ee540a79ea78ceee0b0e3c1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.031436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1387d8e0aa04724abe5004e77d47ca9, user_id=3c149b035ee540a79ea78ceee0b0e3c1, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.036282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.038668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a157a26-507e-4b86-8ce8-ab329c4483ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e92fc1d0530479f98bb6c2813c6f538, user_id=a7cfb0a20d8946c4a6970dff384c9775, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.048051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a157a26-507e-4b86-8ce8-ab329c4483ce admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.066522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 967/1939] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:53 2022] PUT /identity/v3/projects/b1387d8e0aa04724abe5004e77d47ca9/users/3c149b035ee540a79ea78ceee0b0e3c1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:54.070358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.079787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 973/1940] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:53 2022] PUT /identity/v3/projects/9e92fc1d0530479f98bb6c2813c6f538/users/a7cfb0a20d8946c4a6970dff384c9775/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:54.091826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650d19-463a-4cc6-9ac1-ee5ad83525da None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.092203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650d19-463a-4cc6-9ac1-ee5ad83525da None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.092541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650d19-463a-4cc6-9ac1-ee5ad83525da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.156437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cf650d19-463a-4cc6-9ac1-ee5ad83525da None None] MFA Rules not processed for user `a7cfb0a20d8946c4a6970dff384c9775`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:54.158376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf650d19-463a-4cc6-9ac1-ee5ad83525da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:54.178404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148f05-b7fd-4a33-8ef0-5e1d84cd28a0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.255664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.256302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.257028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.257028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.257515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.259207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.272599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 968/1941] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:54.276754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.282241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 974/1942] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:54.286075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:54.287864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650d19-463a-4cc6-9ac1-ee5ad83525da None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.292626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c8008-8a39-42f7-85b4-7828edf53f83 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.298656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd226-35f3-4996-aa2f-ab6bee69c618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.299499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd226-35f3-4996-aa2f-ab6bee69c618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.299879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd226-35f3-4996-aa2f-ab6bee69c618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.300333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd226-35f3-4996-aa2f-ab6bee69c618 admin admin] PATH_INFO: `/v3/projects/b1387d8e0aa04724abe5004e77d47ca9/users/3c149b035ee540a79ea78ceee0b0e3c1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.302418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd226-35f3-4996-aa2f-ab6bee69c618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1387d8e0aa04724abe5004e77d47ca9, user_id=3c149b035ee540a79ea78ceee0b0e3c1, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.302834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650d19-463a-4cc6-9ac1-ee5ad83525da None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.305256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd226-35f3-4996-aa2f-ab6bee69c618 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.307701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.308317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.308594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.308863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.309638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.311832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.333530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 969/1943] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:54 2022] PUT /identity/v3/projects/b1387d8e0aa04724abe5004e77d47ca9/users/3c149b035ee540a79ea78ceee0b0e3c1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:54.336795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.337231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.340137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.348236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 975/1944] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:54 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:54.349428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.379457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] MFA Rules not processed for user `3c149b035ee540a79ea78ceee0b0e3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:54.379457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:54.437501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fc7d9-a09d-482b-a062-3f9edb25d107 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.442849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.443600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.444067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.444431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.445163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.447960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.457510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:54.468435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 970/1945] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:54.481895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.485769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:54.522359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 976/1946] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:54 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:54.527084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.539718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab3f-d9a8-4ca6-8df2-4791219eda65 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.545256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.546124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.546649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.547567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.548555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.550563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.563104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 977/1947] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:37:54.568109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.580687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e7aea-3810-4b37-a5f8-e0d6d65eb3b6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.587040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.587812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.588096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.588370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] PATH_INFO: `/v3/projects/31e295e18148456e81c0425a0a8c31f1/users/57eec0be451a4e33b7a4f1c78c7e55d6/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.589229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676dcad-f1b1-46d3-89c0-98ca1660f929 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.593723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.594556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.594985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.595353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.606860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.607659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e295e18148456e81c0425a0a8c31f1, user_id=57eec0be451a4e33b7a4f1c78c7e55d6, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.608326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.611224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.620831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 971/1948] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:54.630192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 978/1949] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:54 2022] PUT /identity/v3/projects/31e295e18148456e81c0425a0a8c31f1/users/57eec0be451a4e33b7a4f1c78c7e55d6/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:54.635323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.647632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49b7f-62a7-4ec1-82d8-989dac2dcc19 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.721180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb1461-3a4d-4b02-ad5d-10128f80e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.721876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1461-3a4d-4b02-ad5d-10128f80e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.722159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1461-3a4d-4b02-ad5d-10128f80e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.722429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb1461-3a4d-4b02-ad5d-10128f80e3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.723124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb1461-3a4d-4b02-ad5d-10128f80e3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.724774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb1461-3a4d-4b02-ad5d-10128f80e3e1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.739748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 972/1950] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:54.741720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.756559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1837c-0914-424c-a3e5-719a9c2d3a79 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:54.765037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:54.766193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.766193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.766327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] PATH_INFO: `/v3/projects/31e295e18148456e81c0425a0a8c31f1/users/57eec0be451a4e33b7a4f1c78c7e55d6/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.768327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e295e18148456e81c0425a0a8c31f1, user_id=57eec0be451a4e33b7a4f1c78c7e55d6, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:54.771295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:54.793143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 979/1951] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:54 2022] PUT /identity/v3/projects/31e295e18148456e81c0425a0a8c31f1/users/57eec0be451a4e33b7a4f1c78c7e55d6/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:54.804358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:54.804678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:54.804911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:54.840251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] MFA Rules not processed for user `57eec0be451a4e33b7a4f1c78c7e55d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:54.841484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:54.845975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:54.965530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 973/1952] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:54.984780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:54.987061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.103121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b43a-ca3e-4b61-b3a1-6c0a90bde3f0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:55.107102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:55.107549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:55.108434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:55.108852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:55.119932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:55.121730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:55.136969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 980/1953] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:55.178595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:55.181015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.220841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:55.321266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f5e66-3bbd-480e-959a-e282ce649482 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:55.330505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:55.332026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:55.333857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:55.334393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] PATH_INFO: `/v3/users/9858f9e1f1724cad9de2fa7ec2e882c3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:55.338507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9858f9e1f1724cad9de2fa7ec2e882c3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:55.342348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:55.351203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e2b80-82d6-4411-8ed6-4867fcb51605 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:55.356057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:55.357158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:55.357452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:55.357770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] PATH_INFO: `/v3/projects/de98294de0c94f1b9fc218aed1dbf17a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:55.358925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de98294de0c94f1b9fc218aed1dbf17a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:55.362069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:55.430666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:55.433717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9858f9e1f1724cad9de2fa7ec2e882c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.451075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9858f9e1f1724cad9de2fa7ec2e882c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.458822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de98294de0c94f1b9fc218aed1dbf17a', 'request_id': 'req-2405949e-8eb5-438e-b704-6f0a75484a51'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.460758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9858f9e1f1724cad9de2fa7ec2e882c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.461655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9858f9e1f1724cad9de2fa7ec2e882c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.462331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9858f9e1f1724cad9de2fa7ec2e882c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.467714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de98294de0c94f1b9fc218aed1dbf17a', 'request_id': 'req-2405949e-8eb5-438e-b704-6f0a75484a51'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.480661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de98294de0c94f1b9fc218aed1dbf17a', 'request_id': 'req-2405949e-8eb5-438e-b704-6f0a75484a51'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.489682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 981/1954] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:55 2022] DELETE /identity/v3/users/9858f9e1f1724cad9de2fa7ec2e882c3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:55.494379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:55.496389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.506998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] The token cache is being invalidate because project de98294de0c94f1b9fc218aed1dbf17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:55.507659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.508551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2405949e-8eb5-438e-b704-6f0a75484a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.510691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 974/1955] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:55 2022] DELETE /identity/v3/projects/de98294de0c94f1b9fc218aed1dbf17a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:55.511965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:55.512250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:55.512562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:55.533831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:55.535176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.562881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:55.584697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb33b3-b687-4be6-b709-637888bdc874 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:55.588728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:55.589341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:55.589646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:55.589918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:55.591867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.602531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 975/1956] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:55.603478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:55.604783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.618522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459e70-026b-4c84-819a-41dee4feef1e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:55.623519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:55.624243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:55.624588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:55.624858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] PATH_INFO: `/v3/users/0e55b898da5747beaa12f19eaf0703d3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:55.626086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e55b898da5747beaa12f19eaf0703d3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:55.628110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:55.668410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:55.670102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:55.680287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 982/1957] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:55.681176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:55.682533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.685655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e55b898da5747beaa12f19eaf0703d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.686361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e55b898da5747beaa12f19eaf0703d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.693954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e55b898da5747beaa12f19eaf0703d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.705872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e55b898da5747beaa12f19eaf0703d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.706848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e55b898da5747beaa12f19eaf0703d3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:55.742789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 976/1958] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:55 2022] DELETE /identity/v3/users/0e55b898da5747beaa12f19eaf0703d3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:55.747724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48e9a2-e484-4948-9b44-51128bdc625f service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:55.786406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:55.822787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:55.824907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:55.827291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:55.827769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:55.834815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:55.939481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:55.942309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:55.956885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 983/1959] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:56.551270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:56.553187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:56.571474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b462f-8d35-4cb9-8dd5-b466b50b731f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:56.577625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:56.581960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:56.582602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:56.583167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] PATH_INFO: `/v3/projects/8f98a1eabbf94131b0cbfa55b1fadd51` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:56.602535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f98a1eabbf94131b0cbfa55b1fadd51)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:56.606578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:56.695520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:56.698398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:56.722850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a62d-cbd8-4f50-a7b4-1ae415e65860 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:56.726129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f98a1eabbf94131b0cbfa55b1fadd51', 'request_id': 'req-73c0bbf2-8032-4de7-b7c9-63671e133f77'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.732804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f98a1eabbf94131b0cbfa55b1fadd51', 'request_id': 'req-73c0bbf2-8032-4de7-b7c9-63671e133f77'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.747096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f98a1eabbf94131b0cbfa55b1fadd51', 'request_id': 'req-73c0bbf2-8032-4de7-b7c9-63671e133f77'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.762405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] The token cache is being invalidate because project 8f98a1eabbf94131b0cbfa55b1fadd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:56.762675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.763950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.768577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 977/1960] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:56 2022] DELETE /identity/v3/projects/8f98a1eabbf94131b0cbfa55b1fadd51 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:56.769486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:56.771193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:56.804594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:56.805240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:56.805514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:56.806013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] PATH_INFO: `/v3/projects/09b529d1c1bd47e595f9ce2b13cdb747` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:56.807364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b529d1c1bd47e595f9ce2b13cdb747)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:56.809431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:56.809852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:56.857567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0bbf2-8032-4de7-b7c9-63671e133f77 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:56.864596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:56.865285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:56.865911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:56.866182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] PATH_INFO: `/v3/users/ea37b365d3ea43699ffe7dd8d6d15988` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:56.867334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea37b365d3ea43699ffe7dd8d6d15988)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:56.869993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:56.895842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b529d1c1bd47e595f9ce2b13cdb747', 'request_id': 'req-966de675-18fe-4860-a455-2db1b66a9c5b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.904638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b529d1c1bd47e595f9ce2b13cdb747', 'request_id': 'req-966de675-18fe-4860-a455-2db1b66a9c5b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.912205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b529d1c1bd47e595f9ce2b13cdb747', 'request_id': 'req-966de675-18fe-4860-a455-2db1b66a9c5b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.929400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] The token cache is being invalidate because project 09b529d1c1bd47e595f9ce2b13cdb747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:56.929795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.930501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.932183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 984/1961] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:56 2022] DELETE /identity/v3/projects/09b529d1c1bd47e595f9ce2b13cdb747 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:56.934052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea37b365d3ea43699ffe7dd8d6d15988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.935010 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea37b365d3ea43699ffe7dd8d6d15988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.936317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:56.937830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:56.944000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea37b365d3ea43699ffe7dd8d6d15988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.954069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:56.955550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea37b365d3ea43699ffe7dd8d6d15988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.956362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea37b365d3ea43699ffe7dd8d6d15988'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:56.983302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 978/1962] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:56 2022] DELETE /identity/v3/users/ea37b365d3ea43699ffe7dd8d6d15988 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:57.060935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de675-18fe-4860-a455-2db1b66a9c5b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:57.146234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:57.147074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:57.147413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:57.147729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] PATH_INFO: `/v3/users/3c149b035ee540a79ea78ceee0b0e3c1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:57.148970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c149b035ee540a79ea78ceee0b0e3c1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:57.151130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:57.211258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c149b035ee540a79ea78ceee0b0e3c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.229813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c149b035ee540a79ea78ceee0b0e3c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.241474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c149b035ee540a79ea78ceee0b0e3c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.242362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c149b035ee540a79ea78ceee0b0e3c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.243036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b381866c-736d-408b-93f9-98e37fca1dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c149b035ee540a79ea78ceee0b0e3c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.264670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 985/1963] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:56 2022] DELETE /identity/v3/users/3c149b035ee540a79ea78ceee0b0e3c1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:57.359709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:57.361662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:57.402663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8ca7-6512-436b-b721-166a4f17daef admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:57.500171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:57.500863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:57.502247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:57.503068 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] PATH_INFO: `/v3/projects/f568409f5f7d454f93ff509e2fdbee39` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:57.509503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f568409f5f7d454f93ff509e2fdbee39)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:57.513875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:57.586547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:57.589510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f568409f5f7d454f93ff509e2fdbee39', 'request_id': 'req-43dbf5eb-5811-46f1-a20d-2112c9795e39'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.601275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f568409f5f7d454f93ff509e2fdbee39', 'request_id': 'req-43dbf5eb-5811-46f1-a20d-2112c9795e39'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.618920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f568409f5f7d454f93ff509e2fdbee39', 'request_id': 'req-43dbf5eb-5811-46f1-a20d-2112c9795e39'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.640773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] The token cache is being invalidate because project f568409f5f7d454f93ff509e2fdbee39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:57.641086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.641886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.645184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 979/1964] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:57 2022] DELETE /identity/v3/projects/f568409f5f7d454f93ff509e2fdbee39 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:57.651052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39476-e8b6-42a5-b50f-b9fa7cca9631 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:57.652580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39476-e8b6-42a5-b50f-b9fa7cca9631 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:57.653072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39476-e8b6-42a5-b50f-b9fa7cca9631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:57.698707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-26b39476-e8b6-42a5-b50f-b9fa7cca9631 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:57.700366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-26b39476-e8b6-42a5-b50f-b9fa7cca9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:57.730547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:57.732043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:57.781953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:57.838873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 986/1965] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:57.848174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea0ca4-6110-4dd3-9191-66174c07c3fa None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:57.848465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea0ca4-6110-4dd3-9191-66174c07c3fa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:57.848742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea0ca4-6110-4dd3-9191-66174c07c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:57.861609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbf5eb-5811-46f1-a20d-2112c9795e39 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:57.872270 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:57.873135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:57.873344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:57.874536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] PATH_INFO: `/v3/projects/b1387d8e0aa04724abe5004e77d47ca9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:57.878225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1387d8e0aa04724abe5004e77d47ca9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:57.881204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:57.882480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-74ea0ca4-6110-4dd3-9191-66174c07c3fa None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:57.884074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-74ea0ca4-6110-4dd3-9191-66174c07c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:57.913969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 987/1966] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:57.914848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea0ca4-6110-4dd3-9191-66174c07c3fa None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:57.935281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea0ca4-6110-4dd3-9191-66174c07c3fa None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:57.939589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:57.940298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:57.940475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:57.940829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:57.941509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:57.941816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:57.943720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:57.972597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 988/1967] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:57.973675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:57.983186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1387d8e0aa04724abe5004e77d47ca9', 'request_id': 'req-1c24b60e-19a5-41fa-a71a-07b3506fe07c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:57.995551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabc277-e071-4169-b191-e24b1e33ba75 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.000690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1387d8e0aa04724abe5004e77d47ca9', 'request_id': 'req-1c24b60e-19a5-41fa-a71a-07b3506fe07c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.022582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1387d8e0aa04724abe5004e77d47ca9', 'request_id': 'req-1c24b60e-19a5-41fa-a71a-07b3506fe07c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.062171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] The token cache is being invalidate because project b1387d8e0aa04724abe5004e77d47ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:58.062481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.065394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1c24b60e-19a5-41fa-a71a-07b3506fe07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.070439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 980/1968] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:57 2022] DELETE /identity/v3/projects/b1387d8e0aa04724abe5004e77d47ca9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:58.074963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.075356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362eef5e-49b9-4d04-8467-46ebabe6b8ce None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.075741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.076233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362eef5e-49b9-4d04-8467-46ebabe6b8ce None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.076437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.076637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.077358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.077669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362eef5e-49b9-4d04-8467-46ebabe6b8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.079467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.113275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-362eef5e-49b9-4d04-8467-46ebabe6b8ce None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:58.114772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-362eef5e-49b9-4d04-8467-46ebabe6b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.126806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 989/1969] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:57 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:58.128558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.137343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.148266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 981/1970] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:37:58.156538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c45f6-c0a1-4df5-935d-81a7e6d7ad37 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.156779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c45f6-c0a1-4df5-935d-81a7e6d7ad37 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.157021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c45f6-c0a1-4df5-935d-81a7e6d7ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.191152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f64c45f6-c0a1-4df5-935d-81a7e6d7ad37 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:58.193412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f64c45f6-c0a1-4df5-935d-81a7e6d7ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.251136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ea05-7d87-408b-b8a2-462054ab56a1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.263632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.264133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.264413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.264685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.266770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.267222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:58.268803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.281775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 982/1971] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:58.285850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c45f6-c0a1-4df5-935d-81a7e6d7ad37 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.300292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c45f6-c0a1-4df5-935d-81a7e6d7ad37 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.307985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.308657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.308935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.309219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.309911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:37:58.310195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.312022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.324825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 990/1972] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:58 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:58.338005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 983/1973] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:37:58.338133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.338213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.354742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50fd9-ac02-4504-8e2a-4366fab35abd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.359459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71312db-5ac6-4c48-9db3-9b940eab52fa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.361847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.362544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.362760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.363033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.363791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.365341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.367722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.369162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.369710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.370370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.371205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.374480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.380475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 991/1974] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:58.382250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.404572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795877d-4754-45b7-94f4-89b04a3596cc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.411651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.412420 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.412767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.413105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.413889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.415684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.435234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 992/1975] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:58.447554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.450438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.457915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 984/1976] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:58 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:37:58.458890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.468348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e469b7-4715-48cd-84e7-c8db6cb45475 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.480818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:58.569008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.569989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.570442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.571021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] PATH_INFO: `/v3/users/0386e802908f4d7aa385f523807588a7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.572509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0386e802908f4d7aa385f523807588a7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.574991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.575385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a13a-16b6-47c5-9992-61904a8d2648 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.586314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.587265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.587831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.587831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] PATH_INFO: `/v3/projects/756dd24099fc44d7948e889bb4bfc542/users/43725f0b6e274ed4bfd5e817d10370e7/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.606893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756dd24099fc44d7948e889bb4bfc542, user_id=43725f0b6e274ed4bfd5e817d10370e7, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.609752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.628485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 985/1977] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:58 2022] PUT /identity/v3/projects/756dd24099fc44d7948e889bb4bfc542/users/43725f0b6e274ed4bfd5e817d10370e7/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:58.629397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.659153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0386e802908f4d7aa385f523807588a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.674135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0386e802908f4d7aa385f523807588a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.693035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0386e802908f4d7aa385f523807588a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.693928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0386e802908f4d7aa385f523807588a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.694641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c6396bd-585e-4d9a-88d7-c3f7cfe9d740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0386e802908f4d7aa385f523807588a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:58.715901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 993/1978] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:58 2022] DELETE /identity/v3/users/0386e802908f4d7aa385f523807588a7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:58.717860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3581f-8df3-4756-9340-066994605681 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.718151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3581f-8df3-4756-9340-066994605681 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.718454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3581f-8df3-4756-9340-066994605681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.723896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9c9e8-22a7-4b5a-95a9-3b05ac332390 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.742198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2fd3581f-8df3-4756-9340-066994605681 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:58.743472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2fd3581f-8df3-4756-9340-066994605681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.799782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:58.815118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.816364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.816653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.816976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.817717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.819818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.825612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 994/1979] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:58.829111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.829111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.829111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.846687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 986/1980] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:58 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:58.851286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.853086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.855547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:58.856794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.874248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 995/1981] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:58.875309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.884819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.899425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c697df-3c3e-4b8c-a843-a3c0662e84f3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.907769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.908766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.909272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.909562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.910272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.912116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.923999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 996/1982] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:58.925178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.927164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:58.934859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd96a2e-f16a-41f6-82e6-f81a8b5721a3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.938849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.939468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.939747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.940030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.941368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4815db-a7c7-468f-b36f-517183d278c9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:58.946489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:58.947043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:58.947394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:58.947749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:58.950171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.951771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.959115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:58.960762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:58.963161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 987/1983] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:58.964159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:58.972494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 997/1984] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:37:58.999632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4422159-6f7a-4d4f-8eea-46dbe506bd70 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.006860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c290-fc58-4296-b281-71023d67bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.007490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c290-fc58-4296-b281-71023d67bb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.007904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c290-fc58-4296-b281-71023d67bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.008187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c290-fc58-4296-b281-71023d67bb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.008910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93c290-fc58-4296-b281-71023d67bb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.010571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93c290-fc58-4296-b281-71023d67bb57 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.022990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 988/1985] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:59.027780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.042879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:59.051718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ca5c0-7de1-443e-8f9f-4ca29a5e6778 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.060003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.060770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.061278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.061945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] PATH_INFO: `/v3/projects/50d01e973e1a48ac951baece92e43ca4/users/be8c346086ad4307b38ae5b008ac0a3b/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.083435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d01e973e1a48ac951baece92e43ca4, user_id=be8c346086ad4307b38ae5b008ac0a3b, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.088249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.108728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 998/1986] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:59 2022] PUT /identity/v3/projects/50d01e973e1a48ac951baece92e43ca4/users/be8c346086ad4307b38ae5b008ac0a3b/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:59.121058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcb2fc-21a1-47a7-9546-e2cca1fde999 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.121410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcb2fc-21a1-47a7-9546-e2cca1fde999 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.121785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcb2fc-21a1-47a7-9546-e2cca1fde999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.156237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-15bcb2fc-21a1-47a7-9546-e2cca1fde999 None None] MFA Rules not processed for user `be8c346086ad4307b38ae5b008ac0a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:37:59.157591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15bcb2fc-21a1-47a7-9546-e2cca1fde999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:59.245453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 989/1987] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:37:59.250082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.355865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78286993-a4ad-4e3f-a111-6297f4a20e75 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.361997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.362680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.363326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.363475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.364236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.366780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.403790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 999/1988] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:37:59 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:59.407982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcb2fc-21a1-47a7-9546-e2cca1fde999 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.424518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcb2fc-21a1-47a7-9546-e2cca1fde999 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.495143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.497000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:59.506186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.507499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.507938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.508311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.509122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.511239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.526124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:59.548882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 990/1989] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:37:59 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:37:59.553473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.567046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aca02d-b8e9-4627-afc7-bdee584639c6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.572624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.578138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.578422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.578699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.579377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.581001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.603448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 991/1990] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:59.605113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.623774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1d3a-0822-4af4-afa3-967d208a2d62 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.630045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.630778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.631063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.631341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] PATH_INFO: `/v3/projects/9f4976983f894b3a97d216f12b729b68/users/75ad6d3dcf184c38878fec5733d9bd4e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.641943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bfa44-3aed-480e-9947-7ebe951c924a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.649447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4976983f894b3a97d216f12b729b68, user_id=75ad6d3dcf184c38878fec5733d9bd4e, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.649604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.650304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.650659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.651076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] PATH_INFO: `/v3/projects/1ba720656fbf45d7b1b1f3e46c82bc5e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.652487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.652602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba720656fbf45d7b1b1f3e46c82bc5e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.654740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.689922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 992/1991] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:59 2022] PUT /identity/v3/projects/9f4976983f894b3a97d216f12b729b68/users/75ad6d3dcf184c38878fec5733d9bd4e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:59.691388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.772712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba720656fbf45d7b1b1f3e46c82bc5e', 'request_id': 'req-bc52d095-68ea-4e53-9eae-258fab5a335a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:59.775056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04242272-6d99-4aa6-89df-ac87f62bc043 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.787050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba720656fbf45d7b1b1f3e46c82bc5e', 'request_id': 'req-bc52d095-68ea-4e53-9eae-258fab5a335a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:59.795877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba720656fbf45d7b1b1f3e46c82bc5e', 'request_id': 'req-bc52d095-68ea-4e53-9eae-258fab5a335a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:59.798554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:37:59.819459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] The token cache is being invalidate because project 1ba720656fbf45d7b1b1f3e46c82bc5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:37:59.820116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:59.820591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:37:59.823426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1000/1992] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:37:59 2022] DELETE /identity/v3/projects/1ba720656fbf45d7b1b1f3e46c82bc5e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:37:59.827323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.828761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:59.881038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.882696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.882985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.883255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.886457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.888140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.907268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 993/1993] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:37:59.908407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:37:59.910884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:37:59.929084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52d095-68ea-4e53-9eae-258fab5a335a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.929656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3dd57-b577-4e8a-b3fa-63f1ee7d9aff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:37:59.934767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd3b6-de21-4b46-b9bb-52e2fe0ac850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.935457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd3b6-de21-4b46-b9bb-52e2fe0ac850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.935737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd3b6-de21-4b46-b9bb-52e2fe0ac850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.935936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:37:59.936158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd3b6-de21-4b46-b9bb-52e2fe0ac850 admin admin] PATH_INFO: `/v3/projects/9f4976983f894b3a97d216f12b729b68/users/75ad6d3dcf184c38878fec5733d9bd4e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.936936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.937442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.937841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] PATH_INFO: `/v3/users/a7cfb0a20d8946c4a6970dff384c9775` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:37:59.939377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7cfb0a20d8946c4a6970dff384c9775)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.939522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd3b6-de21-4b46-b9bb-52e2fe0ac850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4976983f894b3a97d216f12b729b68, user_id=75ad6d3dcf184c38878fec5733d9bd4e, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:37:59.941651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.942775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd3b6-de21-4b46-b9bb-52e2fe0ac850 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:37:59.956115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 994/1994] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:37:59 2022] PUT /identity/v3/projects/9f4976983f894b3a97d216f12b729b68/users/75ad6d3dcf184c38878fec5733d9bd4e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:37:59.966784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:37:59.967063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:37:59.967320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:00.021397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] MFA Rules not processed for user `75ad6d3dcf184c38878fec5733d9bd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:00.023268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:00.035598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7cfb0a20d8946c4a6970dff384c9775'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.063406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7cfb0a20d8946c4a6970dff384c9775'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.074906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7cfb0a20d8946c4a6970dff384c9775'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.077107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7cfb0a20d8946c4a6970dff384c9775'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.077880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cd9a4e5f-de52-4d09-8e52-6d7b48b16185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7cfb0a20d8946c4a6970dff384c9775'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.084268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:00.101616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1001/1995] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:37:59 2022] DELETE /identity/v3/users/a7cfb0a20d8946c4a6970dff384c9775 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:00.103345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:00.103633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:00.103907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:00.132821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 995/1996] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:37:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:00.140415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:00.143072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:00.144629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] MFA Rules not processed for user `43725f0b6e274ed4bfd5e817d10370e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:00.146690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:00.225224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa51fb4-2f0c-40b9-b8db-2f09a7b11847 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:00.240115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1002/1997] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:00.247133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:00.249525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:00.257163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:00.291513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:00.292600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:00.292966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:00.293364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:00.339486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843fa3e-adec-4e4b-a04c-30baaefe637c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:00.344603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:00.346401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:00.346401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:00.346401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:00.357216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:00.361201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:00.375106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1003/1998] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:00.399911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:00.403661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:00.417403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 996/1999] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:00.519100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:00.536310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1872ea-3c81-4e53-8a8f-4f8b0859d4cc service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:00.541508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:00.543098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:00.544402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:00.545024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:00.550788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:00.639786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:00.641326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:00.658633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1004/2000] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:00.684673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:00.688506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:00.751269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:00.779505 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31644684-7be2-41fa-bbce-1cdf4b84a964 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:00.784605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:00.785666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:00.785666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:00.786097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] PATH_INFO: `/v3/projects/9e92fc1d0530479f98bb6c2813c6f538` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:00.788000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e92fc1d0530479f98bb6c2813c6f538)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:00.790288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:00.880029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e92fc1d0530479f98bb6c2813c6f538', 'request_id': 'req-e1e43364-db00-4ed0-99fd-154048147496'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.895562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e92fc1d0530479f98bb6c2813c6f538', 'request_id': 'req-e1e43364-db00-4ed0-99fd-154048147496'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.908996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e92fc1d0530479f98bb6c2813c6f538', 'request_id': 'req-e1e43364-db00-4ed0-99fd-154048147496'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.922633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] The token cache is being invalidate because project 9e92fc1d0530479f98bb6c2813c6f538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:00.922921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.923589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:00.925459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 997/2001] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:00 2022] DELETE /identity/v3/projects/9e92fc1d0530479f98bb6c2813c6f538 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:00.929609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:00.943467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89d4f1-5023-4793-a81d-499890f1afdf service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:01.005294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:01.006029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:01.006371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:01.006747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] PATH_INFO: `/v3/users/57eec0be451a4e33b7a4f1c78c7e55d6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:01.007988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57eec0be451a4e33b7a4f1c78c7e55d6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:01.010240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:01.070929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:01.072499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57eec0be451a4e33b7a4f1c78c7e55d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.089066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57eec0be451a4e33b7a4f1c78c7e55d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.096764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57eec0be451a4e33b7a4f1c78c7e55d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.097514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57eec0be451a4e33b7a4f1c78c7e55d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.098201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de280b6f-0352-454d-9949-4f1e03451b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57eec0be451a4e33b7a4f1c78c7e55d6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.118851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1005/2002] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:00 2022] DELETE /identity/v3/users/57eec0be451a4e33b7a4f1c78c7e55d6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:01.427089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:01.428665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:01.443064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43364-db00-4ed0-99fd-154048147496 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:01.521165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:01.523189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:01.523475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:01.523751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] PATH_INFO: `/v3/projects/31e295e18148456e81c0425a0a8c31f1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:01.525180 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e295e18148456e81c0425a0a8c31f1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:01.527155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:01.599945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e295e18148456e81c0425a0a8c31f1', 'request_id': 'req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.606294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e295e18148456e81c0425a0a8c31f1', 'request_id': 'req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.619643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e295e18148456e81c0425a0a8c31f1', 'request_id': 'req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.635303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] The token cache is being invalidate because project 31e295e18148456e81c0425a0a8c31f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:01.635757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.636507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3d9c44ca-d2f7-41a8-b7d1-b0ec4e9cfb2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:01.643964 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 998/2003] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:01 2022] DELETE /identity/v3/projects/31e295e18148456e81c0425a0a8c31f1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:01.645677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0261-3c4c-4c10-aa34-33bd4c55e8d2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:01.646168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0261-3c4c-4c10-aa34-33bd4c55e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:01.646537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0261-3c4c-4c10-aa34-33bd4c55e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:01.700815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8c0b0261-3c4c-4c10-aa34-33bd4c55e8d2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:01.702063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c0b0261-3c4c-4c10-aa34-33bd4c55e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:01.769263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1006/2004] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:01.777784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab5cb7-8710-467d-8cf9-f0575d55de98 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:01.778296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab5cb7-8710-467d-8cf9-f0575d55de98 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:01.778387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab5cb7-8710-467d-8cf9-f0575d55de98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:01.787433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:01.804220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e1ab5cb7-8710-467d-8cf9-f0575d55de98 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:01.805675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e1ab5cb7-8710-467d-8cf9-f0575d55de98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:01.815759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 999/2005] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:01.820926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0261-3c4c-4c10-aa34-33bd4c55e8d2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:01.833179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0261-3c4c-4c10-aa34-33bd4c55e8d2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:01.838748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776abb21-ec22-4445-9224-8cc4c04b45ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:01.839796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abb21-ec22-4445-9224-8cc4c04b45ba admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:01.839796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abb21-ec22-4445-9224-8cc4c04b45ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:01.840080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776abb21-ec22-4445-9224-8cc4c04b45ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:01.840583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776abb21-ec22-4445-9224-8cc4c04b45ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:01.840887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776abb21-ec22-4445-9224-8cc4c04b45ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:01.842784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776abb21-ec22-4445-9224-8cc4c04b45ba admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:01.857335 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1007/2006] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:38:01.862241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab5cb7-8710-467d-8cf9-f0575d55de98 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:01.875655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab5cb7-8710-467d-8cf9-f0575d55de98 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:01.882314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:01.882990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:01.883266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:01.883532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:01.884633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:01.886762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:01.934857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856bcf3-6ea0-4c1e-abb3-a591cb5ad779 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:01.935882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856bcf3-6ea0-4c1e-abb3-a591cb5ad779 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:01.936462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856bcf3-6ea0-4c1e-abb3-a591cb5ad779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:01.961012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1000/2007] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:01 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:01.962492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:01.988425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b856bcf3-6ea0-4c1e-abb3-a591cb5ad779 None None] MFA Rules not processed for user `43725f0b6e274ed4bfd5e817d10370e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:01.991875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b856bcf3-6ea0-4c1e-abb3-a591cb5ad779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:02.072938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1008/2008] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:02.079089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafe8f4-ac04-42b8-901c-c6d8693bbdca admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:02.092583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:02.093213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.093508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.093820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.094432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:02.096401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:02.136550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1001/2009] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:01 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:02.140311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856bcf3-6ea0-4c1e-abb3-a591cb5ad779 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:02.187254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856bcf3-6ea0-4c1e-abb3-a591cb5ad779 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:02.193005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:02.193670 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.193957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.194340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.195001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:02.196652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:02.209585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1009/2010] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:02.213228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:02.224266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669de07-6d5e-4eb5-a80f-45ec1390b878 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:02.229653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f285-efe2-4e35-8481-f53f4d5561ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:02.230300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f285-efe2-4e35-8481-f53f4d5561ef admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.230584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f285-efe2-4e35-8481-f53f4d5561ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.230954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f285-efe2-4e35-8481-f53f4d5561ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.231655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f285-efe2-4e35-8481-f53f4d5561ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:02.233397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f285-efe2-4e35-8481-f53f4d5561ef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:02.246439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1002/2011] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:02.253769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:02.264359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6104fb-8b34-423b-b398-d1fdd465da1c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:02.269683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:02.270396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.270621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.270896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] PATH_INFO: `/v3/projects/355d76686b8246a88f6e3b9e1e4590cc/users/e7fc769bacce4df9b42424c14e461026/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.288307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355d76686b8246a88f6e3b9e1e4590cc, user_id=e7fc769bacce4df9b42424c14e461026, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:02.291482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:02.308860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1010/2012] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:02 2022] PUT /identity/v3/projects/355d76686b8246a88f6e3b9e1e4590cc/users/e7fc769bacce4df9b42424c14e461026/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:02.321465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a32eb-6a30-403a-9b4f-fcbf177f3405 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.322032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a32eb-6a30-403a-9b4f-fcbf177f3405 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.322032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a32eb-6a30-403a-9b4f-fcbf177f3405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.356455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4c9a32eb-6a30-403a-9b4f-fcbf177f3405 None None] MFA Rules not processed for user `e7fc769bacce4df9b42424c14e461026`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:02.357922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4c9a32eb-6a30-403a-9b4f-fcbf177f3405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:02.439442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1003/2013] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:02.453150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:02.455094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:02.488383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:02.534496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b6a51-cf32-45ed-a141-dcac6c12fb65 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:02.538509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ae6eb-d6f8-4956-95ee-8bea4db8b8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:02.539668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae6eb-d6f8-4956-95ee-8bea4db8b8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.539668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae6eb-d6f8-4956-95ee-8bea4db8b8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.539668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae6eb-d6f8-4956-95ee-8bea4db8b8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.555203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ae6eb-d6f8-4956-95ee-8bea4db8b8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:02.557888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ae6eb-d6f8-4956-95ee-8bea4db8b8b7 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:02.570641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1011/2014] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:02.609197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a32eb-6a30-403a-9b4f-fcbf177f3405 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:02.664624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:02.685910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a32eb-6a30-403a-9b4f-fcbf177f3405 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:02.690761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:02.691340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.691616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.691884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] PATH_INFO: `/v3/users/e7fc769bacce4df9b42424c14e461026` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.693035 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fc769bacce4df9b42424c14e461026)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:02.695044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:02.752380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fc769bacce4df9b42424c14e461026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:02.753148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fc769bacce4df9b42424c14e461026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:02.760629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fc769bacce4df9b42424c14e461026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:02.769517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fc769bacce4df9b42424c14e461026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:02.770366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fc769bacce4df9b42424c14e461026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:02.793352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1004/2015] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:02 2022] DELETE /identity/v3/users/e7fc769bacce4df9b42424c14e461026 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:02.798242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:02.798598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:02.799384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:02.820259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:02.821734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:02.901163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1012/2016] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:02.912365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:02.919844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:03.008337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfcbe8-24cb-4ac6-bd59-9da482b6ee96 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:03.012406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:03.013024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:03.013304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:03.013676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:03.024745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:03.026259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:03.039422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1005/2017] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:03.732829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:03.734200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:03.755428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f81a06-b2e6-4f80-b94b-aca4593a75ce None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:03.777334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:03.778022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:03.778295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:03.778562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] PATH_INFO: `/v3/users/be8c346086ad4307b38ae5b008ac0a3b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:03.779709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8c346086ad4307b38ae5b008ac0a3b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:03.781662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:03.857925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8c346086ad4307b38ae5b008ac0a3b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:03.863709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:03.866318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:03.893532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d47c-5c0e-444f-818e-1d9107e9f0bd service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:03.899371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:03.899730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:03.900200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:03.900706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] PATH_INFO: `/v3/projects/355d76686b8246a88f6e3b9e1e4590cc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:03.903069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355d76686b8246a88f6e3b9e1e4590cc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:03.904023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8c346086ad4307b38ae5b008ac0a3b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:03.917450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:03.927221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8c346086ad4307b38ae5b008ac0a3b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:03.928222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8c346086ad4307b38ae5b008ac0a3b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:03.929457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c4cbdc67-c4dc-4fcd-9df3-bd8ea93051c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8c346086ad4307b38ae5b008ac0a3b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:03.959438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1013/2018] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:03 2022] DELETE /identity/v3/users/be8c346086ad4307b38ae5b008ac0a3b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:03.965294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:03.965769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:03.966211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:03.999593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:04.002896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.038334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355d76686b8246a88f6e3b9e1e4590cc', 'request_id': 'req-dd4e619a-589c-45d5-8e32-640f7af0e497'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.047591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355d76686b8246a88f6e3b9e1e4590cc', 'request_id': 'req-dd4e619a-589c-45d5-8e32-640f7af0e497'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.049716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:04.059942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355d76686b8246a88f6e3b9e1e4590cc', 'request_id': 'req-dd4e619a-589c-45d5-8e32-640f7af0e497'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.078691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] The token cache is being invalidate because project 355d76686b8246a88f6e3b9e1e4590cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:04.079132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.079777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd4e619a-589c-45d5-8e32-640f7af0e497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.081694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1006/2019] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:03 2022] DELETE /identity/v3/projects/355d76686b8246a88f6e3b9e1e4590cc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:04.086162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:04.086327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850abca7-a8c0-4986-9f58-f3d518f0cb6f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.087050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850abca7-a8c0-4986-9f58-f3d518f0cb6f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.087050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850abca7-a8c0-4986-9f58-f3d518f0cb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.110279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-850abca7-a8c0-4986-9f58-f3d518f0cb6f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:04.111183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-850abca7-a8c0-4986-9f58-f3d518f0cb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.153649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1014/2020] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:04.161873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.163719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.219958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1007/2021] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:04.223093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4713-1301-46dd-9dc6-746fe242b9e6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.223389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4713-1301-46dd-9dc6-746fe242b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.223667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc4713-1301-46dd-9dc6-746fe242b9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.248799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d8dc4713-1301-46dd-9dc6-746fe242b9e6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:04.249563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d8dc4713-1301-46dd-9dc6-746fe242b9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.259400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1008/2022] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:04.263457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc4713-1301-46dd-9dc6-746fe242b9e6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.274434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e1cb9-8765-4b45-b880-e0efdf3d064d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.279881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc4713-1301-46dd-9dc6-746fe242b9e6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.285178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.285958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.286236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.286783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.288144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:04.288144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.290100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.309079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1009/2023] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:38:04.310020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.328640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d7094-8365-42a2-b12c-a0370a96af55 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.333875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.334593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.334864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.335229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.335875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.338237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.377131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.378379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.378715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.379041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.379289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1010/2024] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:04 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:04.383292 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.395384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.396842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.414947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1015/2025] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:04.481312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd3f04-ae81-4f59-8658-50b0b817f768 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.487045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.487812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.488153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.488546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.489247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.491891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.517174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.518909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.537599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1011/2026] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:04 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:04.538918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8bec7-6d9d-4eeb-bdf6-4930542c78d4 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.540947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.545248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.546298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.546298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.546507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] PATH_INFO: `/v3/users/7b4b07d05af44fc2a5a078680d4615c0` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.547766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4b07d05af44fc2a5a078680d4615c0)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.549839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.553252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69d06-1196-4f25-be35-52c00f36b0aa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.559225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.560047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.560266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.560585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.561310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.563128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.582728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1012/2027] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:04.583847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.598647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebde78-4dbd-41aa-949d-68b30b3e42da admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.603704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.604402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.604759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.605124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.605941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.607725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.614500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4b07d05af44fc2a5a078680d4615c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.633160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4b07d05af44fc2a5a078680d4615c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.636637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1013/2028] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:04.637991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.644853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4b07d05af44fc2a5a078680d4615c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.645611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4b07d05af44fc2a5a078680d4615c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.646241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0b02ef4e-f1b2-4307-b6b9-ff7e7bed055a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4b07d05af44fc2a5a078680d4615c0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:04.648985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115274a-f87f-4205-bd90-9f2dbbefefc7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.655545 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.656090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.656377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.656645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] PATH_INFO: `/v3/projects/3c46d5a7350b4436b6fdb755347d775a/users/ae58acd07f5042279af2508d6629edaa/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.668004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1016/2029] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:04 2022] DELETE /identity/v3/users/7b4b07d05af44fc2a5a078680d4615c0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:04.674636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:04.676591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c46d5a7350b4436b6fdb755347d775a, user_id=ae58acd07f5042279af2508d6629edaa, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.679908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.697480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1014/2030] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:04 2022] PUT /identity/v3/projects/3c46d5a7350b4436b6fdb755347d775a/users/ae58acd07f5042279af2508d6629edaa/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:04.707721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.708006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.708278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.724817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:04.744561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] MFA Rules not processed for user `ae58acd07f5042279af2508d6629edaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:04.746078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.775782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.777529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.837597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1017/2031] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:04.846877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.848698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.910582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cccaf-4ed8-45b2-aefa-0aaffd9f7060 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.917086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.917915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.918725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.920844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] PATH_INFO: `/v3/projects/50d01e973e1a48ac951baece92e43ca4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.922350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d01e973e1a48ac951baece92e43ca4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.924779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.928824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a19ac-3b98-4a64-92a3-04760b3710ad None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.934085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.934715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.934983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.935256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.946329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.949433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:04.967805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1018/2032] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:04.969852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:04.972106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:04.988676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e83bb-4feb-49c4-9897-2cd166e071a5 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:04.994596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:04.995212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:04.995538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:04.995770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] PATH_INFO: `/v3/projects/1e0981e25e554d3685e382387b9bed98` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:04.997270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0981e25e554d3685e382387b9bed98)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:04.999183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.023693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d01e973e1a48ac951baece92e43ca4', 'request_id': 'req-1f85f0a9-c47e-4540-9dad-9102d366b1f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.030654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d01e973e1a48ac951baece92e43ca4', 'request_id': 'req-1f85f0a9-c47e-4540-9dad-9102d366b1f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.042920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d01e973e1a48ac951baece92e43ca4', 'request_id': 'req-1f85f0a9-c47e-4540-9dad-9102d366b1f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.062818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0981e25e554d3685e382387b9bed98', 'request_id': 'req-f3215512-4700-43dd-9542-e924ce684752'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.063009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] The token cache is being invalidate because project 50d01e973e1a48ac951baece92e43ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:05.063319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.064034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.068416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1015/2033] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:04 2022] DELETE /identity/v3/projects/50d01e973e1a48ac951baece92e43ca4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:05.069594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.069786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0981e25e554d3685e382387b9bed98', 'request_id': 'req-f3215512-4700-43dd-9542-e924ce684752'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.071186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:05.079465 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0981e25e554d3685e382387b9bed98', 'request_id': 'req-f3215512-4700-43dd-9542-e924ce684752'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.099935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] The token cache is being invalidate because project 1e0981e25e554d3685e382387b9bed98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:05.103649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.104240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f3215512-4700-43dd-9542-e924ce684752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.110599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1019/2034] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:04 2022] DELETE /identity/v3/projects/1e0981e25e554d3685e382387b9bed98 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:05.115212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaa5e-cec9-43f9-847a-f873e13cfd23 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.115813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaa5e-cec9-43f9-847a-f873e13cfd23 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.116219 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaa5e-cec9-43f9-847a-f873e13cfd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.143063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-daaaaa5e-cec9-43f9-847a-f873e13cfd23 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:05.144418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-daaaaa5e-cec9-43f9-847a-f873e13cfd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:05.169062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85f0a9-c47e-4540-9dad-9102d366b1f5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.171657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:05.218817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:05.273325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1020/2035] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:05.276657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.278448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.278904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.279533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] PATH_INFO: `/v3/users/75ad6d3dcf184c38878fec5733d9bd4e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.281069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ad6d3dcf184c38878fec5733d9bd4e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.281905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ca01a-f3f7-4f06-83ed-2b2ce11fd65c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.282305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ca01a-f3f7-4f06-83ed-2b2ce11fd65c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.282671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ca01a-f3f7-4f06-83ed-2b2ce11fd65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.283357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.309823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-390ca01a-f3f7-4f06-83ed-2b2ce11fd65c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:05.312106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-390ca01a-f3f7-4f06-83ed-2b2ce11fd65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:05.325759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1021/2036] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:05.330433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ca01a-f3f7-4f06-83ed-2b2ce11fd65c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.348386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ca01a-f3f7-4f06-83ed-2b2ce11fd65c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.351335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ad6d3dcf184c38878fec5733d9bd4e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.352177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ad6d3dcf184c38878fec5733d9bd4e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.356227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.356917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.358281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.358643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.359384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:05.359861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.362859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.365857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ad6d3dcf184c38878fec5733d9bd4e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.382819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ad6d3dcf184c38878fec5733d9bd4e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.384326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ad6d3dcf184c38878fec5733d9bd4e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.386124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1022/2037] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:38:05.390436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.394360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:05.417114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1016/2038] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:05 2022] DELETE /identity/v3/users/75ad6d3dcf184c38878fec5733d9bd4e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:05.423701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67173e-3b6e-43f4-a374-d31e8dd32fde admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.603506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.604153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.604528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.604806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.605450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.607451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.717678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1023/2039] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:05 2022] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:05.718925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.735753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49725d57-6314-411e-9507-0bb2072e464b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.807623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.808400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.808688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.808957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.809627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.811724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.842646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1017/2040] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:05 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:05.846761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.863101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0584b1-3333-4ae8-9e6a-32bf6d4e6400 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.868837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.869458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.869782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.870032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.870679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.872359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.883073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.885259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:05.889605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1024/2041] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:38:05.893193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.902487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a0f8-25b4-4c55-bc58-d00970cd00a5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.911058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.911651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e1b84-3ccc-42f4-ad85-6ad1d0b2c4cc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.912059 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.912507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.913086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] PATH_INFO: `/v3/projects/9f4976983f894b3a97d216f12b729b68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.914694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4976983f894b3a97d216f12b729b68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.917154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.925268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.926179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.926574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.926875 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.928864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.932250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.946851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1025/2042] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:05.951175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:05.962866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52e2a6-7cfe-4ddb-ba5d-78efe8064d4e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:05.971023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:05.971164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7a87c-0aec-4340-a7a7-1a26bca1966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:05.972062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7a87c-0aec-4340-a7a7-1a26bca1966c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:05.972062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7a87c-0aec-4340-a7a7-1a26bca1966c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:05.972345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7a87c-0aec-4340-a7a7-1a26bca1966c admin admin] PATH_INFO: `/v3/projects/a9f0f0ee63b74c6cb1756ca975dd6e29/users/b9aa4f911e2d4dc9ad92a7d2960de8e2/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:05.991084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7a87c-0aec-4340-a7a7-1a26bca1966c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f0f0ee63b74c6cb1756ca975dd6e29, user_id=b9aa4f911e2d4dc9ad92a7d2960de8e2, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:05.991298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4976983f894b3a97d216f12b729b68', 'request_id': 'req-c9eda6af-30df-4828-9bfc-2b517a026d67'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:05.995338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7a87c-0aec-4340-a7a7-1a26bca1966c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:05.999774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4976983f894b3a97d216f12b729b68', 'request_id': 'req-c9eda6af-30df-4828-9bfc-2b517a026d67'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:06.007894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4976983f894b3a97d216f12b729b68', 'request_id': 'req-c9eda6af-30df-4828-9bfc-2b517a026d67'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:06.009876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1026/2043] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:05 2022] PUT /identity/v3/projects/a9f0f0ee63b74c6cb1756ca975dd6e29/users/b9aa4f911e2d4dc9ad92a7d2960de8e2/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:06.019983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.020174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.020269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.021685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] The token cache is being invalidate because project 9f4976983f894b3a97d216f12b729b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:06.022281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:06.022648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c9eda6af-30df-4828-9bfc-2b517a026d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:06.027420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1018/2044] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:05 2022] DELETE /identity/v3/projects/9f4976983f894b3a97d216f12b729b68 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:06.028914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea5eb4-294a-45f7-8d97-9d194152904d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.029132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea5eb4-294a-45f7-8d97-9d194152904d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.029354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea5eb4-294a-45f7-8d97-9d194152904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.049338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-65ea5eb4-294a-45f7-8d97-9d194152904d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:06.050520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-65ea5eb4-294a-45f7-8d97-9d194152904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:06.054135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] MFA Rules not processed for user `b9aa4f911e2d4dc9ad92a7d2960de8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:06.055547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:06.087347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:06.115275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1019/2045] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:06.123700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bec2a-0574-4f51-8961-4e29b239dd0f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.124083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bec2a-0574-4f51-8961-4e29b239dd0f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.124437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bec2a-0574-4f51-8961-4e29b239dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.132293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1027/2046] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:06.134643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.135643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:06.147078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a65bec2a-0574-4f51-8961-4e29b239dd0f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:06.148263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a65bec2a-0574-4f51-8961-4e29b239dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:06.150703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831fdd4-7297-460d-b0c4-c5ce610348f0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.156854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.157467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.157794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.158238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1020/2047] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:06.158356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.158924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.161104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.162385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bec2a-0574-4f51-8961-4e29b239dd0f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.171447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bec2a-0574-4f51-8961-4e29b239dd0f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.177095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.177755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.178006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.178269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.179140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:06.179244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.181173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.194498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1028/2048] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:06.195975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1021/2049] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:38:06.198526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.199946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.210889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbb9cb-3359-45df-8de8-5fae2858a5db admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.273345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a179d-8cc4-41de-98d3-8135fd2bfca9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.278838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.279445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.280980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.280980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.280980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.282549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.286824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.287536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.287882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.288217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.288923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.291034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.308163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1029/2050] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:06.311560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.321628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b3362-f2d6-4e60-b493-9d922bc09c1b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.325597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1022/2051] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:06.330532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.360537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:06.399012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.399569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.399842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.400108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.400755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.402731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.406238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee72f54-953d-4986-92b9-346566ec2c89 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.411211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.412050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.412431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.412801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.413718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.414975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1030/2052] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:38:06.418833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.422104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.432809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764beea-a0aa-4af7-81cb-fe24a894420d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.439792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.440190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.442341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.442469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] PATH_INFO: `/v3/projects/94a89ecf3fd44c2fa915d7886866bb34/users/490cd04d9e494766ba21151b69b5495e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.447656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1023/2053] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:06.451747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.460889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a89ecf3fd44c2fa915d7886866bb34, user_id=490cd04d9e494766ba21151b69b5495e, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.464984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.468955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb78c-4c50-408f-be11-ddfd61177ba1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.475300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.476006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.476342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.476672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.477736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.479905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.484186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1031/2054] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:06 2022] PUT /identity/v3/projects/94a89ecf3fd44c2fa915d7886866bb34/users/490cd04d9e494766ba21151b69b5495e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:06.488079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.492036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1024/2055] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:38:06.496429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.505418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:06.521248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be560bf-e8f2-478c-9881-815875fd970d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.585152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52161648-7051-49c5-9f3b-c1c7a9ace6b8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.593651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.594654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.594959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.595234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.596632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.599932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.608217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.609094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.609697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.610104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.611039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.613536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.619679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1032/2056] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:06.623247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.647595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1025/2057] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:06.648446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e2bb1-bdb4-464b-9182-96672e092182 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.651681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.665186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6d21d-4318-4b1e-9f98-b79e9d915271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.665917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d21d-4318-4b1e-9f98-b79e9d915271 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.666374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d21d-4318-4b1e-9f98-b79e9d915271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.666703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d21d-4318-4b1e-9f98-b79e9d915271 admin admin] PATH_INFO: `/v3/projects/94a89ecf3fd44c2fa915d7886866bb34/users/490cd04d9e494766ba21151b69b5495e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.669709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58656568-c53e-4230-b545-0b5fc8bd8b44 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:06.671581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d21d-4318-4b1e-9f98-b79e9d915271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a89ecf3fd44c2fa915d7886866bb34, user_id=490cd04d9e494766ba21151b69b5495e, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.674288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d21d-4318-4b1e-9f98-b79e9d915271 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.683362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b0d15-8210-4281-a8b0-79ffe8a072aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:06.684334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0d15-8210-4281-a8b0-79ffe8a072aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.684829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0d15-8210-4281-a8b0-79ffe8a072aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.685316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0d15-8210-4281-a8b0-79ffe8a072aa admin admin] PATH_INFO: `/v3/projects/640e0ae08a3b471d84adde51773aef82/users/8905a3ccda814459948492faee2e3a19/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.693222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1033/2058] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:06 2022] PUT /identity/v3/projects/94a89ecf3fd44c2fa915d7886866bb34/users/490cd04d9e494766ba21151b69b5495e/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:06.704732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.705400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.706223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.706364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b0d15-8210-4281-a8b0-79ffe8a072aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=640e0ae08a3b471d84adde51773aef82, user_id=8905a3ccda814459948492faee2e3a19, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:06.708828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b0d15-8210-4281-a8b0-79ffe8a072aa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:06.737450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1026/2059] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:06 2022] PUT /identity/v3/projects/640e0ae08a3b471d84adde51773aef82/users/8905a3ccda814459948492faee2e3a19/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:06.743287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede126b-6ce2-43bc-82bf-ce4f8ff06bb5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:06.743574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede126b-6ce2-43bc-82bf-ce4f8ff06bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:06.743845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede126b-6ce2-43bc-82bf-ce4f8ff06bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:06.761089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] MFA Rules not processed for user `490cd04d9e494766ba21151b69b5495e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:06.762543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:06.795192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7ede126b-6ce2-43bc-82bf-ce4f8ff06bb5 None None] MFA Rules not processed for user `8905a3ccda814459948492faee2e3a19`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:06.796496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7ede126b-6ce2-43bc-82bf-ce4f8ff06bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:06.886962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1034/2060] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:06.894764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.896328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:06.901399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1027/2061] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:06.905816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede126b-6ce2-43bc-82bf-ce4f8ff06bb5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:06.915802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:07.003602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50dd8b-7f40-4e77-99d3-4e5e5654cc3f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.008899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.009661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.010017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.010357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.023690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.025225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.025434 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede126b-6ce2-43bc-82bf-ce4f8ff06bb5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.031540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.032219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.032881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.033154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.033809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.035701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.043978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1035/2062] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:07.070582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1028/2063] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:06 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:07.075069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.086474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21f3f-8405-4578-a339-55f7c1b98f52 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.106686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:07.188888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.194253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.194630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.194910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.195626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.198021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.237573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1036/2064] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:07 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:07.241881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.253727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdcae6-eeb2-48e9-a2ec-f54875ccf7ff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.261894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.262744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.263277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.263617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.264339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.266050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.281294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1029/2065] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:38:07.282617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.300036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abb681-b99d-4bae-adb9-6c4626066e33 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.304873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.305708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.306057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.306394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] PATH_INFO: `/v3/projects/680408d9cac04c8b9d9d73db7e809f8b/users/f2b20545ed824d53b85a480c9f80374b/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.322632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680408d9cac04c8b9d9d73db7e809f8b, user_id=f2b20545ed824d53b85a480c9f80374b, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.325475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.340311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1037/2066] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:07 2022] PUT /identity/v3/projects/680408d9cac04c8b9d9d73db7e809f8b/users/f2b20545ed824d53b85a480c9f80374b/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:07.344419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.359372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5330a-34a3-4b05-8234-6e920c473535 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.431119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b2254-fd6e-4dc4-9008-4aa964e9565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.431860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2254-fd6e-4dc4-9008-4aa964e9565a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.432250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2254-fd6e-4dc4-9008-4aa964e9565a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.432591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2254-fd6e-4dc4-9008-4aa964e9565a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.433304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b2254-fd6e-4dc4-9008-4aa964e9565a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.435088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b2254-fd6e-4dc4-9008-4aa964e9565a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.449598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1030/2067] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:07.451705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.463472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f9759-ccb3-4121-b22c-2bc81c2b9ff9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.468926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.469622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.469906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.470175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] PATH_INFO: `/v3/projects/680408d9cac04c8b9d9d73db7e809f8b/users/f2b20545ed824d53b85a480c9f80374b/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.472109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680408d9cac04c8b9d9d73db7e809f8b, user_id=f2b20545ed824d53b85a480c9f80374b, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.474768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.485867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1038/2068] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:07 2022] PUT /identity/v3/projects/680408d9cac04c8b9d9d73db7e809f8b/users/f2b20545ed824d53b85a480c9f80374b/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:07.497250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d817-1696-4fc8-a8ba-cb903d88c471 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.497558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d817-1696-4fc8-a8ba-cb903d88c471 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.497853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6d817-1696-4fc8-a8ba-cb903d88c471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.522290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.530939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-edb6d817-1696-4fc8-a8ba-cb903d88c471 None None] MFA Rules not processed for user `f2b20545ed824d53b85a480c9f80374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:07.532226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-edb6d817-1696-4fc8-a8ba-cb903d88c471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:07.586987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c53e0a-6028-4d45-8f34-6003136ae776 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.591819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.592393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.592674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.592945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] PATH_INFO: `/v3/users/b9aa4f911e2d4dc9ad92a7d2960de8e2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.594204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9aa4f911e2d4dc9ad92a7d2960de8e2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.596128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.597233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:07.603147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1031/2069] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:07.614382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6d817-1696-4fc8-a8ba-cb903d88c471 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.648136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9aa4f911e2d4dc9ad92a7d2960de8e2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:07.663787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9aa4f911e2d4dc9ad92a7d2960de8e2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:07.672144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6d817-1696-4fc8-a8ba-cb903d88c471 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.674694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9aa4f911e2d4dc9ad92a7d2960de8e2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:07.675560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9aa4f911e2d4dc9ad92a7d2960de8e2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:07.676190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.676312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-883d0aef-3ff9-41bc-a100-9d40e273b7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9aa4f911e2d4dc9ad92a7d2960de8e2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:07.676795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.677075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.677341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.679435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:07.679873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:07.693728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.695165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.696958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1039/2070] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:07 2022] DELETE /identity/v3/users/b9aa4f911e2d4dc9ad92a7d2960de8e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:07.702440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.703781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.704005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.707808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1032/2071] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:07.724800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:07.726073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:07.762208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.763885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:07.776383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc40b5-982f-46e0-b0ed-bdb9d89ca22e service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.796808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1040/2072] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:07.807097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:07.808508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:07.849231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.849824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.850124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.850391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.852157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:07.868435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58119c32-f13a-41b7-b964-09eb68804b0b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:07.873060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:07.873772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:07.874033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:07.874324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:07.883780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.885212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.894568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1041/2073] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:07.912807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:07.914289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:07.924134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1033/2074] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:08.198354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:08.199858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:08.234188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443fe7b-6706-4898-9bbe-61c128434348 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:08.241970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:08.243448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:08.245374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:08.245374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] PATH_INFO: `/v3/projects/a9f0f0ee63b74c6cb1756ca975dd6e29` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:08.246192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f0f0ee63b74c6cb1756ca975dd6e29)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:08.249004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:08.310203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f0f0ee63b74c6cb1756ca975dd6e29', 'request_id': 'req-5d8d3756-675c-4230-8772-66464a1ecb17'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.319622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f0f0ee63b74c6cb1756ca975dd6e29', 'request_id': 'req-5d8d3756-675c-4230-8772-66464a1ecb17'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.325818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f0f0ee63b74c6cb1756ca975dd6e29', 'request_id': 'req-5d8d3756-675c-4230-8772-66464a1ecb17'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.340836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] The token cache is being invalidate because project a9f0f0ee63b74c6cb1756ca975dd6e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:08.341127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.341829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.343417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1042/2075] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:08 2022] DELETE /identity/v3/projects/a9f0f0ee63b74c6cb1756ca975dd6e29 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:08.347646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:08.360585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99237909-c641-4091-b0bf-98c013a09087 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:08.418245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:08.424480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:08.425118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:08.425530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:08.425843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] PATH_INFO: `/v3/users/490cd04d9e494766ba21151b69b5495e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:08.427039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=490cd04d9e494766ba21151b69b5495e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:08.429037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:08.488363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490cd04d9e494766ba21151b69b5495e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.489096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490cd04d9e494766ba21151b69b5495e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.499500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490cd04d9e494766ba21151b69b5495e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.508281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490cd04d9e494766ba21151b69b5495e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.508939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6f64fb4-8c96-47bf-868f-6698f175a4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490cd04d9e494766ba21151b69b5495e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.529197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1034/2076] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:08 2022] DELETE /identity/v3/users/490cd04d9e494766ba21151b69b5495e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:08.837689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:08.841150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:08.863229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3756-675c-4230-8772-66464a1ecb17 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:08.891904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:08.936223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:08.936915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:08.937130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:08.937404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] PATH_INFO: `/v3/projects/94a89ecf3fd44c2fa915d7886866bb34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:08.938723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a89ecf3fd44c2fa915d7886866bb34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:08.940621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:08.991130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a89ecf3fd44c2fa915d7886866bb34', 'request_id': 'req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:08.998772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a89ecf3fd44c2fa915d7886866bb34', 'request_id': 'req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:09.005527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a89ecf3fd44c2fa915d7886866bb34', 'request_id': 'req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:09.019427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] The token cache is being invalidate because project 94a89ecf3fd44c2fa915d7886866bb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:09.019734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:09.020380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ed69b62c-c405-4ffe-ad48-fafd9700d0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:09.021926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1043/2077] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:08 2022] DELETE /identity/v3/projects/94a89ecf3fd44c2fa915d7886866bb34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:09.027799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085a546-9ab4-4eb2-a04f-ef05f6d1fa8f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.028286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085a546-9ab4-4eb2-a04f-ef05f6d1fa8f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.028366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085a546-9ab4-4eb2-a04f-ef05f6d1fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.049989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7085a546-9ab4-4eb2-a04f-ef05f6d1fa8f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:09.051198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7085a546-9ab4-4eb2-a04f-ef05f6d1fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:09.137406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1035/2078] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:09.139675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ac19-0ace-42be-8ad5-eec5cb1f6720 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.139953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ac19-0ace-42be-8ad5-eec5cb1f6720 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.140223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8ac19-0ace-42be-8ad5-eec5cb1f6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.161714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1aa8ac19-0ace-42be-8ad5-eec5cb1f6720 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:09.163173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1aa8ac19-0ace-42be-8ad5-eec5cb1f6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:09.171440 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1044/2079] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:09.176086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085a546-9ab4-4eb2-a04f-ef05f6d1fa8f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.186150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085a546-9ab4-4eb2-a04f-ef05f6d1fa8f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.191075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.191587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.191865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.192139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.192820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:09.193125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.194764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.207945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1036/2080] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:38:09.211525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8ac19-0ace-42be-8ad5-eec5cb1f6720 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.222375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8ac19-0ace-42be-8ad5-eec5cb1f6720 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.227749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.228123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.228609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.228720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.229756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.231864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.264904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1045/2081] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:09.268918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.295211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96d7e-df86-45b9-aa39-6de7dac95e00 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.376431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.377113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.377478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.377849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.378535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.380674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.392647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:09.408401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1037/2082] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:09 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:09.413799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.424628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b9d5-9dbe-4d74-af0b-72040eef38d6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.432007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.432007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.432007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.432007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.432394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.433631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.445209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1046/2083] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:09.449204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.459939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d783324-e1b0-4483-abcf-d292b2118e3f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.465127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38018-0e0f-41ee-8cb1-84d66069e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.465762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38018-0e0f-41ee-8cb1-84d66069e0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.466045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38018-0e0f-41ee-8cb1-84d66069e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.466430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38018-0e0f-41ee-8cb1-84d66069e0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.467082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38018-0e0f-41ee-8cb1-84d66069e0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.468748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38018-0e0f-41ee-8cb1-84d66069e0f2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.482044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1038/2084] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:09.486112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.496764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f145-b962-43cb-a354-518fb213b08d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.501394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.502082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.502363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.502638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] PATH_INFO: `/v3/projects/81426728631141668d19d162ca48dc08/users/619cc4888a7842fea0b6f30146e4e961/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.518690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] RBAC: Authorizing `identity:create_grant(project_id=81426728631141668d19d162ca48dc08, user_id=619cc4888a7842fea0b6f30146e4e961, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.521379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.535250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1047/2085] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:09 2022] PUT /identity/v3/projects/81426728631141668d19d162ca48dc08/users/619cc4888a7842fea0b6f30146e4e961/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:09.545527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203db1f-8cd8-4411-b0cf-b3c55d623616 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.545844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203db1f-8cd8-4411-b0cf-b3c55d623616 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.546117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203db1f-8cd8-4411-b0cf-b3c55d623616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.574147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d203db1f-8cd8-4411-b0cf-b3c55d623616 None None] MFA Rules not processed for user `619cc4888a7842fea0b6f30146e4e961`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:09.575372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d203db1f-8cd8-4411-b0cf-b3c55d623616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:09.645392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1039/2086] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:09.650082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.710093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:09.727571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0968e-7203-470f-a14e-5dc1621053be admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.734691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.735319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.735594 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.736092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.736497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.738866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.819300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1048/2087] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:09 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:09.823621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203db1f-8cd8-4411-b0cf-b3c55d623616 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.841907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203db1f-8cd8-4411-b0cf-b3c55d623616 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.901712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.902240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.902523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.902804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.903495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.905473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.930644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1040/2088] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:09 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:09.934772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.945163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9721ec-1234-43ea-ba03-5e5ec27ad9da admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.949877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.950480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.950751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.951019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:09.951657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:09.953269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:09.964717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1049/2089] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:09.969387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:09.980078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23f9db-40ba-4ada-8947-4d1c69f1a179 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:09.985242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:09.985929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:09.986204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:09.986469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] PATH_INFO: `/v3/projects/333f88e0b4ac42c3a5f53a672f5fd30e/users/3fab7dc99d3944938fb64fe29b70717a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.003340 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333f88e0b4ac42c3a5f53a672f5fd30e, user_id=3fab7dc99d3944938fb64fe29b70717a, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:10.006069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:10.021771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1041/2090] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:09 2022] PUT /identity/v3/projects/333f88e0b4ac42c3a5f53a672f5fd30e/users/3fab7dc99d3944938fb64fe29b70717a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:10.025965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:10.036690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c617a-8160-4481-8d44-be4b644c5c85 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:10.092607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8101d0-67ff-422e-952b-df34d60322fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:10.093209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8101d0-67ff-422e-952b-df34d60322fb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:10.093484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8101d0-67ff-422e-952b-df34d60322fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:10.093796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8101d0-67ff-422e-952b-df34d60322fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.094409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8101d0-67ff-422e-952b-df34d60322fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:10.096238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8101d0-67ff-422e-952b-df34d60322fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:10.106544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1050/2091] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:10.110788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:10.122097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778af0da-2ee6-4443-b395-23f0e3a7a9c2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:10.130148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:10.131127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:10.131476 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:10.131818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] PATH_INFO: `/v3/projects/333f88e0b4ac42c3a5f53a672f5fd30e/users/3fab7dc99d3944938fb64fe29b70717a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.133970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] RBAC: Authorizing `identity:create_grant(project_id=333f88e0b4ac42c3a5f53a672f5fd30e, user_id=3fab7dc99d3944938fb64fe29b70717a, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:10.136743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:10.156466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1042/2092] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:10 2022] PUT /identity/v3/projects/333f88e0b4ac42c3a5f53a672f5fd30e/users/3fab7dc99d3944938fb64fe29b70717a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:10.168171 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5607f0-bf9f-411c-bbb8-f9aeb0e1229a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:10.168478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5607f0-bf9f-411c-bbb8-f9aeb0e1229a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:10.168760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5607f0-bf9f-411c-bbb8-f9aeb0e1229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.199602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3b5607f0-bf9f-411c-bbb8-f9aeb0e1229a None None] MFA Rules not processed for user `3fab7dc99d3944938fb64fe29b70717a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:10.200942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3b5607f0-bf9f-411c-bbb8-f9aeb0e1229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:10.286357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1051/2093] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:10.298113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:10.300011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:10.331761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:10.365911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c908869-247f-43ec-944e-7ac0eead704d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:10.370105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328be1d-ac8e-4f0b-af3d-65e6ad8ca494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:10.370716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328be1d-ac8e-4f0b-af3d-65e6ad8ca494 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:10.370994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328be1d-ac8e-4f0b-af3d-65e6ad8ca494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:10.371261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328be1d-ac8e-4f0b-af3d-65e6ad8ca494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.380852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328be1d-ac8e-4f0b-af3d-65e6ad8ca494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:10.382307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328be1d-ac8e-4f0b-af3d-65e6ad8ca494 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:10.395310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1043/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:10.425073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5607f0-bf9f-411c-bbb8-f9aeb0e1229a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:10.475621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:10.501406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5607f0-bf9f-411c-bbb8-f9aeb0e1229a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:10.506365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:10.507005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:10.507388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:10.507674 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] PATH_INFO: `/v3/users/619cc4888a7842fea0b6f30146e4e961` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.509000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619cc4888a7842fea0b6f30146e4e961)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:10.510969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:10.564702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619cc4888a7842fea0b6f30146e4e961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:10.582264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619cc4888a7842fea0b6f30146e4e961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:10.589582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619cc4888a7842fea0b6f30146e4e961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:10.590486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619cc4888a7842fea0b6f30146e4e961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:10.591121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619cc4888a7842fea0b6f30146e4e961'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:10.605933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1052/2095] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:10 2022] DELETE /identity/v3/users/619cc4888a7842fea0b6f30146e4e961 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:10.610470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:10.610826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:10.611175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.630867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:10.632071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:10.692093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1044/2096] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:10.705600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:10.707127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:10.769622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bf0fa-70c2-4484-b105-9a781c907495 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:10.773947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:10.774581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:10.774931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:10.775199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:10.784668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:10.786124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:10.796009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1053/2097] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:11.104082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:11.106200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:11.129109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13eb3a-7468-4b99-bc9f-d5609a46445f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:11.139593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:11.142869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:11.143190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:11.143768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] PATH_INFO: `/v3/projects/81426728631141668d19d162ca48dc08` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:11.146274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81426728631141668d19d162ca48dc08)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:11.148525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:11.227483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81426728631141668d19d162ca48dc08', 'request_id': 'req-5434bff9-09c9-481c-a9a4-d587d05a48d8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.235817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81426728631141668d19d162ca48dc08', 'request_id': 'req-5434bff9-09c9-481c-a9a4-d587d05a48d8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.246563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81426728631141668d19d162ca48dc08', 'request_id': 'req-5434bff9-09c9-481c-a9a4-d587d05a48d8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.262304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] The token cache is being invalidate because project 81426728631141668d19d162ca48dc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:11.262598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.263344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.265368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1045/2098] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:11 2022] DELETE /identity/v3/projects/81426728631141668d19d162ca48dc08 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:11.269446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:11.282250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cd928-1ec5-4033-ab1a-0ec1f39e48da service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:11.352124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:11.352800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:11.353076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:11.353381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] PATH_INFO: `/v3/users/3fab7dc99d3944938fb64fe29b70717a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:11.354552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fab7dc99d3944938fb64fe29b70717a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:11.357382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:11.363210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:11.453968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fab7dc99d3944938fb64fe29b70717a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.491717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fab7dc99d3944938fb64fe29b70717a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.500871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fab7dc99d3944938fb64fe29b70717a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.501630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fab7dc99d3944938fb64fe29b70717a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.502443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a7eadae3-9559-4d77-9168-0bed31b63935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fab7dc99d3944938fb64fe29b70717a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.520919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1054/2099] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:11 2022] DELETE /identity/v3/users/3fab7dc99d3944938fb64fe29b70717a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:11.571730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:11.573428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:11.612152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434bff9-09c9-481c-a9a4-d587d05a48d8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:11.712170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:11.727691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:11.728769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:11.729257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:11.729715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] PATH_INFO: `/v3/users/8905a3ccda814459948492faee2e3a19` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:11.733202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8905a3ccda814459948492faee2e3a19)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:11.736099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:11.808842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8905a3ccda814459948492faee2e3a19'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.810789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8905a3ccda814459948492faee2e3a19'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.819601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8905a3ccda814459948492faee2e3a19'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.834174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8905a3ccda814459948492faee2e3a19'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.848616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8905a3ccda814459948492faee2e3a19'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:11.859439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1046/2100] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:11 2022] DELETE /identity/v3/users/8905a3ccda814459948492faee2e3a19 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:11.863938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:11.864581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:11.865027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:11.893668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:11.894887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:11.927509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:11.928997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:11.996264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1055/2101] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:12.005089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.013056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.034534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b331ec0-6339-43b0-8b5a-e458b6a749d8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.039478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.040279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.040496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.040765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] PATH_INFO: `/v3/projects/333f88e0b4ac42c3a5f53a672f5fd30e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.042317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=333f88e0b4ac42c3a5f53a672f5fd30e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.044231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.076115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c2592-2a8b-474f-80b6-62338569d388 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.080634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ee0ae-2fee-4e2c-97b4-d65436ca1776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.081244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ee0ae-2fee-4e2c-97b4-d65436ca1776 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.081517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ee0ae-2fee-4e2c-97b4-d65436ca1776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.081813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ee0ae-2fee-4e2c-97b4-d65436ca1776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.092885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ee0ae-2fee-4e2c-97b4-d65436ca1776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.094548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ee0ae-2fee-4e2c-97b4-d65436ca1776 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.095437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333f88e0b4ac42c3a5f53a672f5fd30e', 'request_id': 'req-293162fb-3f27-4ba0-839e-0d8476a4da4f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.101648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333f88e0b4ac42c3a5f53a672f5fd30e', 'request_id': 'req-293162fb-3f27-4ba0-839e-0d8476a4da4f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.105748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1056/2102] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:12.119324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333f88e0b4ac42c3a5f53a672f5fd30e', 'request_id': 'req-293162fb-3f27-4ba0-839e-0d8476a4da4f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.129102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:12.133215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] The token cache is being invalidate because project 333f88e0b4ac42c3a5f53a672f5fd30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:12.133906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.135151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-293162fb-3f27-4ba0-839e-0d8476a4da4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.137577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1047/2103] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:11 2022] DELETE /identity/v3/projects/333f88e0b4ac42c3a5f53a672f5fd30e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:12.143220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdeb0-eec1-4279-977c-af9768f4b314 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.143629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdeb0-eec1-4279-977c-af9768f4b314 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.143961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdeb0-eec1-4279-977c-af9768f4b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.165745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-731cdeb0-eec1-4279-977c-af9768f4b314 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:12.167004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-731cdeb0-eec1-4279-977c-af9768f4b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.192208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:12.246344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1057/2104] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:12.253896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12920-0940-4e05-b240-41c1df908d0b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.254181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12920-0940-4e05-b240-41c1df908d0b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.254453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e12920-0940-4e05-b240-41c1df908d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.275558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f0e12920-0940-4e05-b240-41c1df908d0b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:12.277253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f0e12920-0940-4e05-b240-41c1df908d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.285945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1048/2105] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:12.290017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdeb0-eec1-4279-977c-af9768f4b314 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.301238 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdeb0-eec1-4279-977c-af9768f4b314 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.310337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.310969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.311249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.311519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.312551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:12.312551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.314726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.328592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1058/2106] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:38:12.334266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12920-0940-4e05-b240-41c1df908d0b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.345189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e12920-0940-4e05-b240-41c1df908d0b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.350206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.351627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.352210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.352588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.353306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.355543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.395101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1049/2107] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:12 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:12.399317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.412231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194ecc0-44be-474b-81fd-daae374a05b0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.446808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.448744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.499326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.500023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.500486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.500849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.501577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.503562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.524948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7b8eb-701b-4296-b9af-1299e593ad99 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.530480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.531117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.531398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.531672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] PATH_INFO: `/v3/projects/640e0ae08a3b471d84adde51773aef82` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.532801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640e0ae08a3b471d84adde51773aef82)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.534862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.535496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1059/2108] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:12 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:12.536683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.548850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b439b-931a-4b7e-ad05-5d59554bb489 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.553941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.554927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.555215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.555520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.556166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.557782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.571996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1060/2109] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:12.575728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.586014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287fc8-476e-4d29-8894-586aa4d5ea2b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.592943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640e0ae08a3b471d84adde51773aef82', 'request_id': 'req-e5258d12-f041-4e61-8b00-abc275c06f86'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.599885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640e0ae08a3b471d84adde51773aef82', 'request_id': 'req-e5258d12-f041-4e61-8b00-abc275c06f86'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.609791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640e0ae08a3b471d84adde51773aef82', 'request_id': 'req-e5258d12-f041-4e61-8b00-abc275c06f86'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.624113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] The token cache is being invalidate because project 640e0ae08a3b471d84adde51773aef82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:12.624409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.625086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.626634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1050/2110] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:12 2022] DELETE /identity/v3/projects/640e0ae08a3b471d84adde51773aef82 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:12.630453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.632354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.656764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.657503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.657886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.658077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.658770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.660879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.672277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1061/2111] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:12.677234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.678978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.692429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218dba-f1b6-4cd8-838e-7c6206b13041 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.699001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20cb68-27bd-4103-8710-8c4e33f57f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.700066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cb68-27bd-4103-8710-8c4e33f57f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.700494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cb68-27bd-4103-8710-8c4e33f57f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.700971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cb68-27bd-4103-8710-8c4e33f57f05 admin admin] PATH_INFO: `/v3/projects/ba32e89259be49699aa8e671f03a2b21/users/2fef1d9d1b554d92b7844341b558225c/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.710385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5258d12-f041-4e61-8b00-abc275c06f86 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.717788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20cb68-27bd-4103-8710-8c4e33f57f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba32e89259be49699aa8e671f03a2b21, user_id=2fef1d9d1b554d92b7844341b558225c, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.717925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.718593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.718879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.719182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] PATH_INFO: `/v3/users/f2b20545ed824d53b85a480c9f80374b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.720669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b20545ed824d53b85a480c9f80374b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.720989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20cb68-27bd-4103-8710-8c4e33f57f05 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.723196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:12.728536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:12.749210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1062/2112] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:12 2022] PUT /identity/v3/projects/ba32e89259be49699aa8e671f03a2b21/users/2fef1d9d1b554d92b7844341b558225c/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:12.752585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391eed-5f59-43c9-860d-88c2007d06cf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.752969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391eed-5f59-43c9-860d-88c2007d06cf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.753378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391eed-5f59-43c9-860d-88c2007d06cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.764924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:12.788555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-18391eed-5f59-43c9-860d-88c2007d06cf None None] MFA Rules not processed for user `2fef1d9d1b554d92b7844341b558225c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:12.790134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-18391eed-5f59-43c9-860d-88c2007d06cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.792369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b20545ed824d53b85a480c9f80374b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.793019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b20545ed824d53b85a480c9f80374b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.801073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b20545ed824d53b85a480c9f80374b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.810949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b20545ed824d53b85a480c9f80374b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.811601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b20545ed824d53b85a480c9f80374b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:12.833728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1051/2113] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:12 2022] DELETE /identity/v3/users/f2b20545ed824d53b85a480c9f80374b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:12.874765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1063/2114] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:12.881389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:12.883062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:12.970059 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dc45a-fbae-4f53-8f65-3c1d8003acd8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:12.975407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:12.976056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:12.976332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:12.976627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:12.977296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:12.979268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.016599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1052/2115] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:12 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:13.020763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391eed-5f59-43c9-860d-88c2007d06cf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.089936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391eed-5f59-43c9-860d-88c2007d06cf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.151470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.152080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.152356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.152624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.153267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.155232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.180389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1064/2116] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/users => generated 301 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:13.181602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.192804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2386b-4d79-4464-8679-5d1eba16d9c8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.198101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.198793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.199151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.199564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.200231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.202072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.216894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1053/2117] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:13.217037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.218009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.218724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:13.228042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b676e4-09bd-4e20-b49c-02719646a5c8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.233606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.234338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09508ad4-8bbb-46c1-a728-47cb2311c028 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.234850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.235525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.235525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] PATH_INFO: `/v3/projects/9536e82e9962448bbf8e5a4152250059/users/f2202adc86fb43a18d0683154a039fd8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.242004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.242872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.243156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.243428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] PATH_INFO: `/v3/projects/680408d9cac04c8b9d9d73db7e809f8b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.245011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680408d9cac04c8b9d9d73db7e809f8b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.247221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.251706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9536e82e9962448bbf8e5a4152250059, user_id=f2202adc86fb43a18d0683154a039fd8, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.254430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.269488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1054/2118] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:13 2022] PUT /identity/v3/projects/9536e82e9962448bbf8e5a4152250059/users/f2202adc86fb43a18d0683154a039fd8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:13.273364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.282760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:13.302099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680408d9cac04c8b9d9d73db7e809f8b', 'request_id': 'req-d5730683-e4fc-41c9-b939-b170ab782f33'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:13.308903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680408d9cac04c8b9d9d73db7e809f8b', 'request_id': 'req-d5730683-e4fc-41c9-b939-b170ab782f33'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:13.311985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:13.315513 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680408d9cac04c8b9d9d73db7e809f8b', 'request_id': 'req-d5730683-e4fc-41c9-b939-b170ab782f33'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:13.330562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] The token cache is being invalidate because project 680408d9cac04c8b9d9d73db7e809f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:13.330855 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:13.331618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d5730683-e4fc-41c9-b939-b170ab782f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:13.333157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1065/2119] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:13 2022] DELETE /identity/v3/projects/680408d9cac04c8b9d9d73db7e809f8b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:13.338153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfffbb-ef21-4e13-87dc-aa5690c30dc3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.338506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfffbb-ef21-4e13-87dc-aa5690c30dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.338849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfffbb-ef21-4e13-87dc-aa5690c30dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.342812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ebd45-eb00-4198-b11c-eb124aefd12e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.357973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-33cfffbb-ef21-4e13-87dc-aa5690c30dc3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:13.359202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-33cfffbb-ef21-4e13-87dc-aa5690c30dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:13.413104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.413789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.414063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.414392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.415099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.416813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.421977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1066/2120] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:13.431457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1055/2121] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:38:13.431603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddffd9-0fb9-4cfa-9917-1ff1c546c72b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.431603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddffd9-0fb9-4cfa-9917-1ff1c546c72b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.431603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddffd9-0fb9-4cfa-9917-1ff1c546c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.432437 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.434200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:13.448112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4db521-5919-44f4-af59-eefd4b41bcdb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.450856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3cddffd9-0fb9-4cfa-9917-1ff1c546c72b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:13.452164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3cddffd9-0fb9-4cfa-9917-1ff1c546c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:13.452893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92909a-838b-4365-8759-b37589f87242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.453570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92909a-838b-4365-8759-b37589f87242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.453850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92909a-838b-4365-8759-b37589f87242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.454126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92909a-838b-4365-8759-b37589f87242 admin admin] PATH_INFO: `/v3/projects/9536e82e9962448bbf8e5a4152250059/users/f2202adc86fb43a18d0683154a039fd8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.456017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92909a-838b-4365-8759-b37589f87242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9536e82e9962448bbf8e5a4152250059, user_id=f2202adc86fb43a18d0683154a039fd8, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.458695 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92909a-838b-4365-8759-b37589f87242 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.459990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1067/2122] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:13.464257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddffd9-0fb9-4cfa-9917-1ff1c546c72b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.469370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1056/2123] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:13 2022] PUT /identity/v3/projects/9536e82e9962448bbf8e5a4152250059/users/f2202adc86fb43a18d0683154a039fd8/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:13.473726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddffd9-0fb9-4cfa-9917-1ff1c546c72b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.480641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.480925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.481198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.510547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] MFA Rules not processed for user `f2202adc86fb43a18d0683154a039fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:13.511797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:13.530983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.531587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.531864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.532138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.532780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:13.533077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.534727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.549811 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1068/2124] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:38:13.550831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.561165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814041d2-1d1a-43be-a019-688d54bdc237 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.567268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.567876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.568163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.568437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.569072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.571059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.582733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1057/2125] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:13.594273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.595706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:13.605116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1069/2126] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:13.606185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.628894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:13.653058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:13.659799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19506ed6-eb46-4bff-a674-37cc36323d0d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.671609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b06c4-88f3-44e8-9b62-42b1c0eab9b0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.676379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.676986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.677266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.677577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.678197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.680107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.705159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1070/2127] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:13.706302 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.713404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ee6a6-e2fc-4246-83f4-89f9fde5e21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.714058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ee6a6-e2fc-4246-83f4-89f9fde5e21f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.714335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ee6a6-e2fc-4246-83f4-89f9fde5e21f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.714601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ee6a6-e2fc-4246-83f4-89f9fde5e21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.716022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517c81-2e15-4e97-a268-07237eb99659 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.720738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.721351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.721655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.721928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.722567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.724417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.734373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1071/2128] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:13.738493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.748984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f732-68ff-46ca-88b8-f350b67e61d1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.760295 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.761060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.761461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.761816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.762605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.764454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.777222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1072/2129] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:13.783927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.794376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ac220-460e-4359-8614-5e0dec788375 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:13.799769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:13.801272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ee6a6-e2fc-4246-83f4-89f9fde5e21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.802037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.802336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.802662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] PATH_INFO: `/v3/projects/c52fd89996714b29b0c6f80e13f27ac3/users/7b4da26d4ff143cab30193ff994f822b/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.802919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ee6a6-e2fc-4246-83f4-89f9fde5e21f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.813296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1058/2130] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:13.820366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52fd89996714b29b0c6f80e13f27ac3, user_id=7b4da26d4ff143cab30193ff994f822b, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:13.823431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:13.840092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1073/2131] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:13 2022] PUT /identity/v3/projects/c52fd89996714b29b0c6f80e13f27ac3/users/7b4da26d4ff143cab30193ff994f822b/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:13.850275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb571a-eea3-434e-a6ca-faf5883012ef None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:13.850561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb571a-eea3-434e-a6ca-faf5883012ef None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:13.850832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb571a-eea3-434e-a6ca-faf5883012ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:13.900411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d1fb571a-eea3-434e-a6ca-faf5883012ef None None] MFA Rules not processed for user `7b4da26d4ff143cab30193ff994f822b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:13.901747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d1fb571a-eea3-434e-a6ca-faf5883012ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:13.984657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:13.986933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1059/2132] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:13.991675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb571a-eea3-434e-a6ca-faf5883012ef None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.041966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:14.060977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604475ef-2843-493f-a427-e7b4ae9ed9e1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.066635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.067627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.067627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.067917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] PATH_INFO: `/v3/users/2fef1d9d1b554d92b7844341b558225c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.069037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fef1d9d1b554d92b7844341b558225c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.071322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.075142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb571a-eea3-434e-a6ca-faf5883012ef None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.081164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.081925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.082146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.082417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.083049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.085256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.125736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1060/2133] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:13 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:14.127632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.143232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fef1d9d1b554d92b7844341b558225c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.159205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fef1d9d1b554d92b7844341b558225c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.161036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:14.170738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fef1d9d1b554d92b7844341b558225c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.171752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fef1d9d1b554d92b7844341b558225c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.172790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ef6fc8fd-8e78-4ee0-aeb8-93bb8de418ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fef1d9d1b554d92b7844341b558225c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.193626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1074/2134] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:13 2022] DELETE /identity/v3/users/2fef1d9d1b554d92b7844341b558225c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:14.198272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.198599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.198872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.209242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dd906-4cda-4e76-89bd-1df366519e63 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.219802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:14.220997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:14.278120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.278878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.279197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.279869 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.280515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.282907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.299705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1075/2135] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:14.310186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.311133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1061/2136] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:14 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:14.314495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.314607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:14.316421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:14.338567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296f614-317a-4a5e-924d-447736debbaa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.343742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.344348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.344626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.344927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.345594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.347208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.362591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1062/2137] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:38:14.363503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.374674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d566d-d1d5-497c-9eab-bd0210cb51d8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.380614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e04828-ae0f-469c-aaab-d5073699d2c2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.384259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.384835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.385172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.385413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.385537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.385899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.386077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.386181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] PATH_INFO: `/v3/projects/ac5e1b03ec0a4041a7ecf36ddd1bf7ac/users/8b8d178d3aab492abeaf79a5b5e8aeab/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.406914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.408641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5e1b03ec0a4041a7ecf36ddd1bf7ac, user_id=8b8d178d3aab492abeaf79a5b5e8aeab, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.408770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.411797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.419571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1076/2138] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:14.427156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1063/2139] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:14 2022] PUT /identity/v3/projects/ac5e1b03ec0a4041a7ecf36ddd1bf7ac/users/8b8d178d3aab492abeaf79a5b5e8aeab/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:14.431254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.442983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8c207-d3f3-44d7-9767-15ee596cfa24 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.516223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2319cf-8cf5-4fc8-b3cc-93d4b74053be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.517643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2319cf-8cf5-4fc8-b3cc-93d4b74053be admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.518092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2319cf-8cf5-4fc8-b3cc-93d4b74053be admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.518499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2319cf-8cf5-4fc8-b3cc-93d4b74053be admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.519280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2319cf-8cf5-4fc8-b3cc-93d4b74053be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.521009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2319cf-8cf5-4fc8-b3cc-93d4b74053be admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.535647 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1077/2140] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:14.539993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.552117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ddef-6c75-42f2-b5f2-07028ab84547 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.556999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.557742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.557959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.558226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] PATH_INFO: `/v3/projects/ac5e1b03ec0a4041a7ecf36ddd1bf7ac/users/8b8d178d3aab492abeaf79a5b5e8aeab/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.560124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5e1b03ec0a4041a7ecf36ddd1bf7ac, user_id=8b8d178d3aab492abeaf79a5b5e8aeab, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.562823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.581224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1064/2141] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:14 2022] PUT /identity/v3/projects/ac5e1b03ec0a4041a7ecf36ddd1bf7ac/users/8b8d178d3aab492abeaf79a5b5e8aeab/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:14.587510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.587796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.588070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.624049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] MFA Rules not processed for user `8b8d178d3aab492abeaf79a5b5e8aeab`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:14.625471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:14.638723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:14.710542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1078/2142] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:14.724482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.726880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:14.737167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.738714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:14.773870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:14.845214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90050378-efab-4fd9-a998-bd2b816fd4c8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.850160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.850840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.851110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.851692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] PATH_INFO: `/v3/projects/ba32e89259be49699aa8e671f03a2b21` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.852958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba32e89259be49699aa8e671f03a2b21)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.853486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6d26-fdfa-4940-88b1-7c617f009690 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:14.854914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.858506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:14.859190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:14.859535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:14.859880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:14.861914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:14.910891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba32e89259be49699aa8e671f03a2b21', 'request_id': 'req-6cb141aa-0986-4ceb-9ef8-30fd049c322f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.918846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba32e89259be49699aa8e671f03a2b21', 'request_id': 'req-6cb141aa-0986-4ceb-9ef8-30fd049c322f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.924801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba32e89259be49699aa8e671f03a2b21', 'request_id': 'req-6cb141aa-0986-4ceb-9ef8-30fd049c322f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.927802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:14.929282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:14.939040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1065/2143] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:14.939952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] The token cache is being invalidate because project ba32e89259be49699aa8e671f03a2b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:14.940140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.940841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:14.942722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1079/2144] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:14 2022] DELETE /identity/v3/projects/ba32e89259be49699aa8e671f03a2b21 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:14.946778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:14.961383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b292e38-1e07-43e9-b387-f55bef7bd34e service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:15.036739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:15.037502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:15.037817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:15.038087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] PATH_INFO: `/v3/users/f2202adc86fb43a18d0683154a039fd8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:15.039220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2202adc86fb43a18d0683154a039fd8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:15.041315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:15.097416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2202adc86fb43a18d0683154a039fd8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.098462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2202adc86fb43a18d0683154a039fd8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.107196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2202adc86fb43a18d0683154a039fd8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.117112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2202adc86fb43a18d0683154a039fd8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.117822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0b6eb3ca-34ad-40f4-b67e-83ef5e4914ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2202adc86fb43a18d0683154a039fd8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.128802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:15.149331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1066/2145] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:14 2022] DELETE /identity/v3/users/f2202adc86fb43a18d0683154a039fd8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:15.538614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:15.540631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:15.556005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb141aa-0986-4ceb-9ef8-30fd049c322f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:15.591789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:15.621577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:15.623240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:15.623519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:15.623860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] PATH_INFO: `/v3/projects/9536e82e9962448bbf8e5a4152250059` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:15.625697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9536e82e9962448bbf8e5a4152250059)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:15.627682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:15.676930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9536e82e9962448bbf8e5a4152250059', 'request_id': 'req-36eae808-24c2-438b-9b8b-422ca4584a03'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.683349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9536e82e9962448bbf8e5a4152250059', 'request_id': 'req-36eae808-24c2-438b-9b8b-422ca4584a03'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.689655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9536e82e9962448bbf8e5a4152250059', 'request_id': 'req-36eae808-24c2-438b-9b8b-422ca4584a03'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.703711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] The token cache is being invalidate because project 9536e82e9962448bbf8e5a4152250059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:15.703997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.704616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-36eae808-24c2-438b-9b8b-422ca4584a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:15.706231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1080/2146] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:15 2022] DELETE /identity/v3/projects/9536e82e9962448bbf8e5a4152250059 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:15.711992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dcef5-737f-4c41-8814-962dd00a3d0a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:15.712484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dcef5-737f-4c41-8814-962dd00a3d0a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:15.712572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dcef5-737f-4c41-8814-962dd00a3d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:15.734920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-101dcef5-737f-4c41-8814-962dd00a3d0a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:15.736219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-101dcef5-737f-4c41-8814-962dd00a3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:15.795700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1067/2147] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:15.803733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c32f2-ae90-4f4e-a1d1-645b9333f32b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:15.804010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c32f2-ae90-4f4e-a1d1-645b9333f32b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:15.804275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c32f2-ae90-4f4e-a1d1-645b9333f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:15.825618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-946c32f2-ae90-4f4e-a1d1-645b9333f32b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:15.826886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-946c32f2-ae90-4f4e-a1d1-645b9333f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:15.835220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1081/2148] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:15.840198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dcef5-737f-4c41-8814-962dd00a3d0a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:15.850023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dcef5-737f-4c41-8814-962dd00a3d0a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:15.855558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:15.856144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:15.856414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:15.856679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:15.857318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:15.857630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:15.859216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:15.871741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1068/2149] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:38:15.876176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c32f2-ae90-4f4e-a1d1-645b9333f32b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:15.886686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c32f2-ae90-4f4e-a1d1-645b9333f32b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:15.891356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:15.891983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:15.892278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:15.892557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:15.893154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:15.895059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:15.923761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1082/2150] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:15 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:15.928007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:15.939202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0e5b9-bfda-4dfe-9074-5c53da894786 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.000721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.001320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.001623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.001896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.002522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.004428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.031321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1069/2151] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:15 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:16.035733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.046648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b15ec-d500-418d-ae52-58d55573f817 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.051473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.052067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.052342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.052606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.053259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.054940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.065813 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1083/2152] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:16.070005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.080349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a24f7a-2460-4615-a831-98ba5e88bbef admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.085174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.085795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.086067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.086332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.087001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.088581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.099637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1070/2153] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:16.100166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.102321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.103767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.114123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372b57-3d84-4d79-9e5d-460e48afd85a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.118247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d02de-8122-4167-a6a1-7709ba7c24d8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.119390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4647117-0733-4b91-aed1-66d78683a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.120261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4647117-0733-4b91-aed1-66d78683a893 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.120533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4647117-0733-4b91-aed1-66d78683a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.120774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4647117-0733-4b91-aed1-66d78683a893 admin admin] PATH_INFO: `/v3/projects/2a10a66bc9c143b89a632bd581e4f904/users/6c808ba45bcd418e86ecb7f518eeb970/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.124643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.125278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.125817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.126469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] PATH_INFO: `/v3/users/ae58acd07f5042279af2508d6629edaa` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.129189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae58acd07f5042279af2508d6629edaa)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.134402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.136336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4647117-0733-4b91-aed1-66d78683a893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a10a66bc9c143b89a632bd581e4f904, user_id=6c808ba45bcd418e86ecb7f518eeb970, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.139157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4647117-0733-4b91-aed1-66d78683a893 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.154009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1071/2154] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:16 2022] PUT /identity/v3/projects/2a10a66bc9c143b89a632bd581e4f904/users/6c808ba45bcd418e86ecb7f518eeb970/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:16.164767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.165021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.165295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.191950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae58acd07f5042279af2508d6629edaa'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.197737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] MFA Rules not processed for user `6c808ba45bcd418e86ecb7f518eeb970`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:16.198946 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.203845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae58acd07f5042279af2508d6629edaa'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.210920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae58acd07f5042279af2508d6629edaa'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.211671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae58acd07f5042279af2508d6629edaa'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.212288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-944e3aae-b449-4f99-92b5-fe8136ab6d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae58acd07f5042279af2508d6629edaa'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.219574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:16.225779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:16.231668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1084/2155] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:16 2022] DELETE /identity/v3/users/ae58acd07f5042279af2508d6629edaa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:16.236364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.236927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.237470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.257803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:16.259136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.273969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1072/2156] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:16.285683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.287048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.326137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1085/2157] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:16.336442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.338557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.358063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243267-1e21-4cd7-b9a4-db56a8942460 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.400349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04228a0b-e333-475b-9bf7-8d85850bb8d3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.404260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.405051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.405331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.405650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.409001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.409624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.409901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.410166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.419860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.421379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.443522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1086/2158] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:16.444298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.446525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.461310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8ea94-a42d-4ed5-884a-c8536b532d15 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.465287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead9a7e-cbe5-4898-80c0-d46be6dd3032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.465985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead9a7e-cbe5-4898-80c0-d46be6dd3032 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.466262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead9a7e-cbe5-4898-80c0-d46be6dd3032 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.467020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead9a7e-cbe5-4898-80c0-d46be6dd3032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.468625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bead9a7e-cbe5-4898-80c0-d46be6dd3032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.487002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.488626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.500445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1073/2159] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:16.522896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.525062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.552547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a103b8-3389-4f0f-b5f5-b68f7ad34de9 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.555803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead9a7e-cbe5-4898-80c0-d46be6dd3032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.558240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead9a7e-cbe5-4898-80c0-d46be6dd3032 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.558562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.559214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.559495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.559769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] PATH_INFO: `/v3/users/6c808ba45bcd418e86ecb7f518eeb970` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.561033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c808ba45bcd418e86ecb7f518eeb970)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.563298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.571716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1087/2160] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:16.610616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:16.637411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c808ba45bcd418e86ecb7f518eeb970'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.638512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c808ba45bcd418e86ecb7f518eeb970'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.647901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c808ba45bcd418e86ecb7f518eeb970'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.658578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c808ba45bcd418e86ecb7f518eeb970'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.659446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c808ba45bcd418e86ecb7f518eeb970'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:16.696691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1074/2161] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:16 2022] DELETE /identity/v3/users/6c808ba45bcd418e86ecb7f518eeb970 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:16.701521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.702158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.702570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.729113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:16.730852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.780088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:16.812649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1088/2162] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:16.822800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.824331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.891507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfa8e8-5fda-48db-8de1-b6ef4c24a3e6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.894923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:16.896301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.896754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:16.897062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.897348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.897633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.907940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.909393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.911011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9dac-fc3a-4dc8-a87d-afc669094b59 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:16.919099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:16.919653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:16.919928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:16.920114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1075/2163] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:16.920265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] PATH_INFO: `/v3/projects/3c46d5a7350b4436b6fdb755347d775a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:16.921646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c46d5a7350b4436b6fdb755347d775a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:16.924043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:16.990093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c46d5a7350b4436b6fdb755347d775a', 'request_id': 'req-e611b241-f741-4297-8cbd-624b2086f746'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.001086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c46d5a7350b4436b6fdb755347d775a', 'request_id': 'req-e611b241-f741-4297-8cbd-624b2086f746'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.007204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c46d5a7350b4436b6fdb755347d775a', 'request_id': 'req-e611b241-f741-4297-8cbd-624b2086f746'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.019687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] The token cache is being invalidate because project 3c46d5a7350b4436b6fdb755347d775a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:17.019969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.020933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e611b241-f741-4297-8cbd-624b2086f746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.023069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1089/2164] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:16 2022] DELETE /identity/v3/projects/3c46d5a7350b4436b6fdb755347d775a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:38:17.224479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:17.226481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:17.243056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b51f59-5505-4bca-958b-e2f55455feef service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:17.305977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:17.306600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.306879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.307124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] PATH_INFO: `/v3/projects/2a10a66bc9c143b89a632bd581e4f904` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.308244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a10a66bc9c143b89a632bd581e4f904)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:17.310217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:17.356542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:17.357737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a10a66bc9c143b89a632bd581e4f904', 'request_id': 'req-177d7a66-45a3-4be4-afb3-05e564b3062b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.364989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a10a66bc9c143b89a632bd581e4f904', 'request_id': 'req-177d7a66-45a3-4be4-afb3-05e564b3062b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.374058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a10a66bc9c143b89a632bd581e4f904', 'request_id': 'req-177d7a66-45a3-4be4-afb3-05e564b3062b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.386802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] The token cache is being invalidate because project 2a10a66bc9c143b89a632bd581e4f904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:17.387189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.387920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-177d7a66-45a3-4be4-afb3-05e564b3062b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:17.389509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1076/2165] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:17 2022] DELETE /identity/v3/projects/2a10a66bc9c143b89a632bd581e4f904 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:17.395447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514130-4ef9-40d1-af59-433ef59e1b89 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.395729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514130-4ef9-40d1-af59-433ef59e1b89 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.396003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514130-4ef9-40d1-af59-433ef59e1b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.416177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bf514130-4ef9-40d1-af59-433ef59e1b89 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:17.418100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf514130-4ef9-40d1-af59-433ef59e1b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:17.503586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1090/2166] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:17.514396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4ca4-1040-42be-9d81-4cc45c66fce9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.514679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4ca4-1040-42be-9d81-4cc45c66fce9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.514947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4ca4-1040-42be-9d81-4cc45c66fce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.535953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4bce4ca4-1040-42be-9d81-4cc45c66fce9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:17.536816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4bce4ca4-1040-42be-9d81-4cc45c66fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:17.545080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1077/2167] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:17.549403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514130-4ef9-40d1-af59-433ef59e1b89 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:17.559258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514130-4ef9-40d1-af59-433ef59e1b89 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:17.564158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:17.564746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.564988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.565272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.565952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:17.566243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:17.567831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:17.581051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1091/2168] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:38:17.585584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce4ca4-1040-42be-9d81-4cc45c66fce9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:17.595119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce4ca4-1040-42be-9d81-4cc45c66fce9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:17.600001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:17.600585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.600857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.601120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.601774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:17.603747 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:17.637063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1078/2169] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:17 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:17.641582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:17.652921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ec11-0eb6-4bcf-916c-adce79a1ac8e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:17.703857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:17.718703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf463-e208-4284-9916-129919656764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:17.719590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf463-e208-4284-9916-129919656764 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.719871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf463-e208-4284-9916-129919656764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.720142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cf463-e208-4284-9916-129919656764 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.720785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cf463-e208-4284-9916-129919656764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:17.722831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cf463-e208-4284-9916-129919656764 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:17.751311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1092/2170] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:17 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:17.752493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:17.764346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b327d9-0e6a-4782-bdb8-3db94ac2d05c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:17.772786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:17.773416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.773727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.773999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.774644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:17.776293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:17.792675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1079/2171] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:17.794702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf463-e208-4284-9916-129919656764 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:17.806677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cf463-e208-4284-9916-129919656764 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:17.812493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb778a-a05d-4928-8765-74f1e0899af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:17.813388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb778a-a05d-4928-8765-74f1e0899af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.813791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb778a-a05d-4928-8765-74f1e0899af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.814153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb778a-a05d-4928-8765-74f1e0899af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.814886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb778a-a05d-4928-8765-74f1e0899af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:17.816564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb778a-a05d-4928-8765-74f1e0899af8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:17.829145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1093/2172] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:17.833982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:17.847672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25cd5-5906-4d74-977b-190e51511cb4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:17.855941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:17.856330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.856682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.857023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] PATH_INFO: `/v3/projects/e7237329d6a4478e92bb1658b6f0a7a8/users/73c303f12387487a8ad11baedf20ab6b/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.882027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7237329d6a4478e92bb1658b6f0a7a8, user_id=73c303f12387487a8ad11baedf20ab6b, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:17.884914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:17.901480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1080/2173] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:17 2022] PUT /identity/v3/projects/e7237329d6a4478e92bb1658b6f0a7a8/users/73c303f12387487a8ad11baedf20ab6b/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:17.912598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e379b3-c4a3-4d57-b46d-130126db4e88 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:17.912887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e379b3-c4a3-4d57-b46d-130126db4e88 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:17.913161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e379b3-c4a3-4d57-b46d-130126db4e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:17.944881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-54e379b3-c4a3-4d57-b46d-130126db4e88 None None] MFA Rules not processed for user `73c303f12387487a8ad11baedf20ab6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:17.946182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-54e379b3-c4a3-4d57-b46d-130126db4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:18.018169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1094/2174] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:18.039193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:18.041057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:18.106277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18414-9245-4776-a250-850cf118ef55 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:18.110205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:18.110808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:18.111082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:18.111346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:18.121978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:18.123500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:18.132282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1081/2175] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:19.491844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6176-39d3-4829-bcfc-4b37081cc49f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:19.492437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6176-39d3-4829-bcfc-4b37081cc49f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:19.492437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6176-39d3-4829-bcfc-4b37081cc49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:19.512048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fb9e6176-39d3-4829-bcfc-4b37081cc49f None None] MFA Rules not processed for user `73c303f12387487a8ad11baedf20ab6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:19.513248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fb9e6176-39d3-4829-bcfc-4b37081cc49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:19.521889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1095/2176] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:20.427973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:20.429626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:20.510786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96b8b3-a250-486b-b654-0bcda3b2b02a service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:20.515919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:20.516556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:20.516839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:20.517111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] PATH_INFO: `/v3/users/7b4da26d4ff143cab30193ff994f822b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:20.518283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4da26d4ff143cab30193ff994f822b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:20.520224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:20.536609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:20.573643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4da26d4ff143cab30193ff994f822b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:20.574554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4da26d4ff143cab30193ff994f822b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:20.581776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4da26d4ff143cab30193ff994f822b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:20.592567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4da26d4ff143cab30193ff994f822b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:20.593246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4da26d4ff143cab30193ff994f822b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:20.611853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1082/2177] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:20 2022] DELETE /identity/v3/users/7b4da26d4ff143cab30193ff994f822b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:20.617004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:20.617482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:20.617887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:20.639240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:20.640462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:20.710489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1096/2178] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:20.720314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:20.721893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:20.787950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f8e24-2cfc-48a3-86d2-f67e03055c3d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:20.791851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:20.794975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:20.795261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:20.795535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:20.807882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:20.810692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:20.827336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1083/2179] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:21.119370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:21.120920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:21.143576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa619a49-0c99-42b9-8ed0-13cf4ef1a805 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:21.155535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:21.156255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:21.156534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:21.156833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] PATH_INFO: `/v3/projects/c52fd89996714b29b0c6f80e13f27ac3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:21.158062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52fd89996714b29b0c6f80e13f27ac3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:21.160279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:21.207570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:21.210995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52fd89996714b29b0c6f80e13f27ac3', 'request_id': 'req-44728429-c2ca-4393-b4a5-6a781230324c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.217973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52fd89996714b29b0c6f80e13f27ac3', 'request_id': 'req-44728429-c2ca-4393-b4a5-6a781230324c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.224907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52fd89996714b29b0c6f80e13f27ac3', 'request_id': 'req-44728429-c2ca-4393-b4a5-6a781230324c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.238327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] The token cache is being invalidate because project c52fd89996714b29b0c6f80e13f27ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:21.238628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.239231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.241052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1097/2180] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:21 2022] DELETE /identity/v3/projects/c52fd89996714b29b0c6f80e13f27ac3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:21.245128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:21.256049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84b357-07b2-4294-b3d2-3c7ddf30b5de service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:21.319215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:21.319874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:21.320149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:21.320420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] PATH_INFO: `/v3/users/8b8d178d3aab492abeaf79a5b5e8aeab` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:21.321844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8d178d3aab492abeaf79a5b5e8aeab)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:21.325727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:21.385457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:21.391771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8d178d3aab492abeaf79a5b5e8aeab'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.392646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8d178d3aab492abeaf79a5b5e8aeab'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.413053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8d178d3aab492abeaf79a5b5e8aeab'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.424939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8d178d3aab492abeaf79a5b5e8aeab'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.425931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a93dda6e-c5b1-4b68-b8e8-b863f5e36c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8d178d3aab492abeaf79a5b5e8aeab'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.447103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1084/2181] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:21 2022] DELETE /identity/v3/users/8b8d178d3aab492abeaf79a5b5e8aeab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:21.772677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:21.775162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:21.789114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44728429-c2ca-4393-b4a5-6a781230324c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:21.871817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:21.872532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:21.872884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:21.873245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] PATH_INFO: `/v3/projects/ac5e1b03ec0a4041a7ecf36ddd1bf7ac` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:21.875056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5e1b03ec0a4041a7ecf36ddd1bf7ac)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:21.877273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:21.931794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5e1b03ec0a4041a7ecf36ddd1bf7ac', 'request_id': 'req-0f233d82-bd52-4c7b-9e86-ad20b2386896'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.938511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5e1b03ec0a4041a7ecf36ddd1bf7ac', 'request_id': 'req-0f233d82-bd52-4c7b-9e86-ad20b2386896'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.947044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5e1b03ec0a4041a7ecf36ddd1bf7ac', 'request_id': 'req-0f233d82-bd52-4c7b-9e86-ad20b2386896'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.961673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] The token cache is being invalidate because project ac5e1b03ec0a4041a7ecf36ddd1bf7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:21.961966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.962625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0f233d82-bd52-4c7b-9e86-ad20b2386896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:21.964153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1098/2182] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:21 2022] DELETE /identity/v3/projects/ac5e1b03ec0a4041a7ecf36ddd1bf7ac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:21.969258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2cdb-913e-496e-8046-e94518a7260d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:21.969789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2cdb-913e-496e-8046-e94518a7260d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:21.970066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f2cdb-913e-496e-8046-e94518a7260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:21.995438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-597f2cdb-913e-496e-8046-e94518a7260d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:21.996670 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-597f2cdb-913e-496e-8046-e94518a7260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:22.060635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1085/2183] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:22.069776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14ff0-5207-493a-b48f-9c65b180582c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.070065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14ff0-5207-493a-b48f-9c65b180582c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.070338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14ff0-5207-493a-b48f-9c65b180582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.092226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a7c14ff0-5207-493a-b48f-9c65b180582c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:22.093676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a7c14ff0-5207-493a-b48f-9c65b180582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:22.105535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1099/2184] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:22.107879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2cdb-913e-496e-8046-e94518a7260d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:22.119136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f2cdb-913e-496e-8046-e94518a7260d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:22.124080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:22.124794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.125067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.125333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.126041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:22.126337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:22.128167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:22.142348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1086/2185] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:38:22.146721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c14ff0-5207-493a-b48f-9c65b180582c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:22.157109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c14ff0-5207-493a-b48f-9c65b180582c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:22.162561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:22.163176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.163754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.164036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.164772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:22.166719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:22.208063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1100/2186] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:22 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:22.212589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:22.226459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654c0c1-5566-4c3b-91e4-1eaea0f91706 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:22.302220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:22.308278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.308278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.308278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.308278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:22.308278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:22.335276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1087/2187] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:22 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:22.338739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:22.349697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c137fd-da95-45f9-8183-18e6a16396f8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:22.356012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:22.356648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.356926 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.357194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.357888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:22.359596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:22.370562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1101/2188] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:22.374555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:22.384960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb82c0-84e5-449f-bdee-cfc66b720d77 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:22.396673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeacd42-2a31-4f67-893b-c95814a7ace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:22.396673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacd42-2a31-4f67-893b-c95814a7ace5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.396673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacd42-2a31-4f67-893b-c95814a7ace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.396673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeacd42-2a31-4f67-893b-c95814a7ace5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.397198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeacd42-2a31-4f67-893b-c95814a7ace5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:22.398845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeacd42-2a31-4f67-893b-c95814a7ace5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:22.410481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1088/2189] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:22.414948 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:22.425022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7390e-cc40-4ade-b052-ae42829c0e70 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:22.430405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:22.431063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.431343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.431613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] PATH_INFO: `/v3/projects/47a57ba196ed4aae9df1943b9254b691/users/8a38dec54a464b8a905601b702a36f48/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.448991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a57ba196ed4aae9df1943b9254b691, user_id=8a38dec54a464b8a905601b702a36f48, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:22.452359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:22.464957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:22.471533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1102/2190] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:22 2022] PUT /identity/v3/projects/47a57ba196ed4aae9df1943b9254b691/users/8a38dec54a464b8a905601b702a36f48/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:22.478427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef24a6a-930d-4072-bbd8-d39e7a5ca381 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.479659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef24a6a-930d-4072-bbd8-d39e7a5ca381 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.480131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef24a6a-930d-4072-bbd8-d39e7a5ca381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.499843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cef24a6a-930d-4072-bbd8-d39e7a5ca381 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:22.500987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cef24a6a-930d-4072-bbd8-d39e7a5ca381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:22.521241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:22.575243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1089/2191] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:22.582873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:22.584962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:22.691373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526f934-d532-43e3-9a2f-7c8ea526f460 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:22.696246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:22.697399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:22.697807 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:22.698098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:22.708771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:22.710482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:22.728453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1103/2192] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:23.841282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367ea0-1754-4984-90ed-d62f4bbc7f7d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:23.841282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367ea0-1754-4984-90ed-d62f4bbc7f7d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:23.841282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9367ea0-1754-4984-90ed-d62f4bbc7f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:23.874649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c9367ea0-1754-4984-90ed-d62f4bbc7f7d None None] MFA Rules not processed for user `8a38dec54a464b8a905601b702a36f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:23.875857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c9367ea0-1754-4984-90ed-d62f4bbc7f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:23.979793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1090/2193] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:23.981909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:23.994101 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf576b-fa19-430b-8ade-c76692fa47bb service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:24.013311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:24.013965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:24.014240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:24.014514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:24.015167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:24.017079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:24.045632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1104/2194] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:23 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:24.049697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9367ea0-1754-4984-90ed-d62f4bbc7f7d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:24.060933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9367ea0-1754-4984-90ed-d62f4bbc7f7d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:24.124268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:24.124928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:24.125205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:24.125474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:24.126221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:24.128216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:24.151083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1091/2195] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:24 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:24.155315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:24.168909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42175a3-963b-4c0d-8e44-c5003f39a8c4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:24.173437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:24.174070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:24.174351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:24.174615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:24.175258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:24.176894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:24.188809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1105/2196] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:38:24.193142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:24.203585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae95ac-f11f-4bcb-ac9b-2f612055644f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:24.208428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:24.209056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:24.209353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:24.209666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] PATH_INFO: `/v3/projects/adff27f9b81342d1bfe792a40af04a78/users/44337b076cef45378a739b92b1f2de48/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:24.225599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adff27f9b81342d1bfe792a40af04a78, user_id=44337b076cef45378a739b92b1f2de48, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:24.228421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:24.247689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1092/2197] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:24 2022] PUT /identity/v3/projects/adff27f9b81342d1bfe792a40af04a78/users/44337b076cef45378a739b92b1f2de48/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:24.251840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:24.262576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864602a-b057-448c-abd7-6ffc3aa0c8a4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:24.319894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ecc6-8773-4175-af95-d3703d82cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:24.320389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ecc6-8773-4175-af95-d3703d82cfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:24.320679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ecc6-8773-4175-af95-d3703d82cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:24.321018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ecc6-8773-4175-af95-d3703d82cfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:24.321681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ecc6-8773-4175-af95-d3703d82cfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:24.323266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ecc6-8773-4175-af95-d3703d82cfa7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:24.333372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1106/2198] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:24.337822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:24.349191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516f110-9339-4ae2-84e1-b735a7de3f53 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:24.357438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743d646-d720-4a6c-9890-705a41a9750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:24.358136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d646-d720-4a6c-9890-705a41a9750a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:24.358410 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d646-d720-4a6c-9890-705a41a9750a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:24.358678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d646-d720-4a6c-9890-705a41a9750a admin admin] PATH_INFO: `/v3/projects/adff27f9b81342d1bfe792a40af04a78/users/44337b076cef45378a739b92b1f2de48/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:24.360675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743d646-d720-4a6c-9890-705a41a9750a admin admin] RBAC: Authorizing `identity:create_grant(project_id=adff27f9b81342d1bfe792a40af04a78, user_id=44337b076cef45378a739b92b1f2de48, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:24.363373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743d646-d720-4a6c-9890-705a41a9750a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:24.375365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1093/2199] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:24 2022] PUT /identity/v3/projects/adff27f9b81342d1bfe792a40af04a78/users/44337b076cef45378a739b92b1f2de48/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:25.042397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:25.042872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:25.042947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:25.073233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] MFA Rules not processed for user `44337b076cef45378a739b92b1f2de48`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:25.078488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:25.145318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:25.177092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1107/2200] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:25.179314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38fb5-0c77-42a4-9218-2c75958eeeae None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:25.179769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38fb5-0c77-42a4-9218-2c75958eeeae None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:25.179846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca38fb5-0c77-42a4-9218-2c75958eeeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:25.194885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:25.208596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8ca38fb5-0c77-42a4-9218-2c75958eeeae None None] MFA Rules not processed for user `8a38dec54a464b8a905601b702a36f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:25.209872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8ca38fb5-0c77-42a4-9218-2c75958eeeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:25.272318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1094/2201] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:25.285039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:25.288473 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:25.363779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44454c3c-d0b2-4f29-941e-613a73595595 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:25.370050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:25.370678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:25.370955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:25.371223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:25.380037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:25.381602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:25.391870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1108/2202] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:35.263293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=23 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:35.386900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=38 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:38.016031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79adf9-ed1d-4c6c-a5c2-6bf69e6d4020 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:38.016550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79adf9-ed1d-4c6c-a5c2-6bf69e6d4020 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:38.016550 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79adf9-ed1d-4c6c-a5c2-6bf69e6d4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:38.038885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3b79adf9-ed1d-4c6c-a5c2-6bf69e6d4020 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:38.040296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3b79adf9-ed1d-4c6c-a5c2-6bf69e6d4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:38.104508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1095/2203] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:38.121983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:38.124004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:38.145527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9aee8-5cd0-453a-bcfb-566719828a6f service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:38.153095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:38.153760 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:38.154036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:38.154300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:38.163002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:38.164600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:38.174597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1109/2204] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:38:42.151673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014187e-455f-4a5e-a955-01d4bf8051e6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:42.152172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014187e-455f-4a5e-a955-01d4bf8051e6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:42.152172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014187e-455f-4a5e-a955-01d4bf8051e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:42.173048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b014187e-455f-4a5e-a955-01d4bf8051e6 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:42.174293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b014187e-455f-4a5e-a955-01d4bf8051e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:42.241400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1096/2205] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:38:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:42.284659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:42.286198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:42.369466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5dba9-a39f-4e99-bc08-0f4bd092e42e service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:42.374698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:42.375310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:42.375592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:42.375864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:42.384803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:42.386506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:42.395728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1110/2206] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:38:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:38:43.003298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a925f75-4176-44b4-aea0-90782bbe039c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.003905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a925f75-4176-44b4-aea0-90782bbe039c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.004388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a925f75-4176-44b4-aea0-90782bbe039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.028670 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7a925f75-4176-44b4-aea0-90782bbe039c None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:43.030335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7a925f75-4176-44b4-aea0-90782bbe039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:43.040416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1097/2207] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 30 00:38:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:43.056579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:43.071347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6d2b-b571-44ce-9206-d9c7841c2a5c service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:43.079008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b40f8-4468-43c3-8a7d-c4c9d4d686c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:43.079741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b40f8-4468-43c3-8a7d-c4c9d4d686c3 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.080122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b40f8-4468-43c3-8a7d-c4c9d4d686c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.080497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b40f8-4468-43c3-8a7d-c4c9d4d686c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.095243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b40f8-4468-43c3-8a7d-c4c9d4d686c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:43.096931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b40f8-4468-43c3-8a7d-c4c9d4d686c3 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:43.106005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1111/2208] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:38:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:38:43.413301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28fe78-0dd2-45da-a4e8-a747e02ca897 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.413851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28fe78-0dd2-45da-a4e8-a747e02ca897 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.413851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28fe78-0dd2-45da-a4e8-a747e02ca897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.438945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8d28fe78-0dd2-45da-a4e8-a747e02ca897 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:43.440312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8d28fe78-0dd2-45da-a4e8-a747e02ca897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:43.449569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1098/2209] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:38:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:43.459204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b798e-064f-4b77-8c90-5b249fa11022 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.459566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b798e-064f-4b77-8c90-5b249fa11022 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.459662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b798e-064f-4b77-8c90-5b249fa11022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.462711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28fe78-0dd2-45da-a4e8-a747e02ca897 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:43.476485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28fe78-0dd2-45da-a4e8-a747e02ca897 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:43.482456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:43.482834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c43b798e-064f-4b77-8c90-5b249fa11022 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:43.483025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.483470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.483960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.484566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c43b798e-064f-4b77-8c90-5b249fa11022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:43.493502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:43.495055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1112/2210] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:43.495396 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:43.503722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1099/2211] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:38:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:38:43.526222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b798e-064f-4b77-8c90-5b249fa11022 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:43.540601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b798e-064f-4b77-8c90-5b249fa11022 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:43.546685 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c62f7-e6d6-4ee6-8d22-6b3cba80bc6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:43.547406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c62f7-e6d6-4ee6-8d22-6b3cba80bc6e service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.547628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c62f7-e6d6-4ee6-8d22-6b3cba80bc6e service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.547893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c62f7-e6d6-4ee6-8d22-6b3cba80bc6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.559210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c62f7-e6d6-4ee6-8d22-6b3cba80bc6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:43.561401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c62f7-e6d6-4ee6-8d22-6b3cba80bc6e service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:43.574551 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1113/2212] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:43.580612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:43.582523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:43.648163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9a86-823f-476f-bedc-fecda52a25dc service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:43.652083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:43.652752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.653159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.653576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.664361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:43.665876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:43.677308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1100/2213] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:43.917704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.917990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.918261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.937958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:43.939165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:43.946541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1114/2214] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 30 00:38:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:43.958865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:43.970194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ca3d0-e8a8-49e7-a1bf-80954bf0e1c7 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:43.975328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8efb6f-94c3-4fe2-a13a-eaf82002886b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:43.975974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8efb6f-94c3-4fe2-a13a-eaf82002886b service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:43.976250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8efb6f-94c3-4fe2-a13a-eaf82002886b service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:43.976519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8efb6f-94c3-4fe2-a13a-eaf82002886b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:43.984612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8efb6f-94c3-4fe2-a13a-eaf82002886b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:43.986235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8efb6f-94c3-4fe2-a13a-eaf82002886b service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:43.994567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1101/2215] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:38:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:38:46.190990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:46.192710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:46.208669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea69933-fbdb-4fb6-b845-0d4c18847f47 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:46.214562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:46.215195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:46.215472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:46.215763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] PATH_INFO: `/v3/users/73c303f12387487a8ad11baedf20ab6b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:46.216974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c303f12387487a8ad11baedf20ab6b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:46.218955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:46.280181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c303f12387487a8ad11baedf20ab6b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.296962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c303f12387487a8ad11baedf20ab6b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.304871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c303f12387487a8ad11baedf20ab6b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.305749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c303f12387487a8ad11baedf20ab6b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.306464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c303f12387487a8ad11baedf20ab6b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.323934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1115/2216] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:46 2022] DELETE /identity/v3/users/73c303f12387487a8ad11baedf20ab6b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:46.330339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:46.330864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:46.330971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:46.350482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:46.351714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:46.356143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:46.418279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1102/2217] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:46.430967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:46.432597 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:46.444332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:46.502071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3030e6-b2c2-4be3-97f2-1536c132a282 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:46.506504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d378e-f349-4098-80b9-38f8e0f0426c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:46.507121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d378e-f349-4098-80b9-38f8e0f0426c service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:46.507400 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d378e-f349-4098-80b9-38f8e0f0426c service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:46.507672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d378e-f349-4098-80b9-38f8e0f0426c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:46.517638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d378e-f349-4098-80b9-38f8e0f0426c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:46.519159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d378e-f349-4098-80b9-38f8e0f0426c service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:46.530185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1116/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:46.816985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:46.818761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:46.843336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962287f5-0d44-4f29-9dda-b3d8de647aa2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:46.857162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:46.857836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:46.858113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:46.858363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] PATH_INFO: `/v3/projects/e7237329d6a4478e92bb1658b6f0a7a8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:46.859526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7237329d6a4478e92bb1658b6f0a7a8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:46.861411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:46.915085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7237329d6a4478e92bb1658b6f0a7a8', 'request_id': 'req-4fdd0d18-2060-478d-8e76-3bfeb372da87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.920632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7237329d6a4478e92bb1658b6f0a7a8', 'request_id': 'req-4fdd0d18-2060-478d-8e76-3bfeb372da87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.928678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7237329d6a4478e92bb1658b6f0a7a8', 'request_id': 'req-4fdd0d18-2060-478d-8e76-3bfeb372da87'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.940821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] The token cache is being invalidate because project e7237329d6a4478e92bb1658b6f0a7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:46.941111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.941792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4fdd0d18-2060-478d-8e76-3bfeb372da87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:46.943662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1103/2219] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:46 2022] DELETE /identity/v3/projects/e7237329d6a4478e92bb1658b6f0a7a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:46.948596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc7a3-22d5-4437-8ef7-c58f5aa05298 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:46.948903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc7a3-22d5-4437-8ef7-c58f5aa05298 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:46.949172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc7a3-22d5-4437-8ef7-c58f5aa05298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:46.969537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4d9bc7a3-22d5-4437-8ef7-c58f5aa05298 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:46.970769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4d9bc7a3-22d5-4437-8ef7-c58f5aa05298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:47.032772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1117/2220] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:47.041130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b153-fd34-4af9-a3d3-1b1c473c004b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.041435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b153-fd34-4af9-a3d3-1b1c473c004b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.041908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b153-fd34-4af9-a3d3-1b1c473c004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.064842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7860b153-fd34-4af9-a3d3-1b1c473c004b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:47.066915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7860b153-fd34-4af9-a3d3-1b1c473c004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:47.076994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1104/2221] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:47.082387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc7a3-22d5-4437-8ef7-c58f5aa05298 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:47.095340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc7a3-22d5-4437-8ef7-c58f5aa05298 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:47.101770 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:47.102474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.102904 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.103418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.104482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:38:47.105036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:47.107160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:47.122227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1118/2222] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:38:47.129493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860b153-fd34-4af9-a3d3-1b1c473c004b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:47.145360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860b153-fd34-4af9-a3d3-1b1c473c004b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:47.152878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:47.153462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.153771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.154065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.154704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:47.156617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:47.187726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1105/2223] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:38:47 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:38:47.192222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:47.202844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221d80a-be7f-4276-bd39-115e49137061 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:47.262452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:47.263260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.263376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.263605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.264256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:47.266283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:47.290512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1119/2224] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:38:47 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:38:47.294599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:47.307730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22783f28-fe9d-49cc-bdd5-d406060d3f09 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:47.314322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:47.315091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.315444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.315907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.316603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:47.318428 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:47.333712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1106/2225] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:47.337655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:47.348350 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e492404-80b2-40a3-8a77-dabdbd205eff admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:47.353567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ce2a-5242-4d1a-adfe-0a914041a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:47.354203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ce2a-5242-4d1a-adfe-0a914041a246 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.354610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ce2a-5242-4d1a-adfe-0a914041a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.354884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ce2a-5242-4d1a-adfe-0a914041a246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.355545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ce2a-5242-4d1a-adfe-0a914041a246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:47.357207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ce2a-5242-4d1a-adfe-0a914041a246 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:47.370431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1120/2226] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:38:47.374904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:47.387429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28df7e-6e28-4c6f-b787-88cfac1d961d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:47.393077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:47.394191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.394470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.394739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] PATH_INFO: `/v3/projects/50357eaeccf2443797b98a3611fba51e/users/c54517471c6245ffa52a27d8d33ce1cf/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.420424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] RBAC: Authorizing `identity:create_grant(project_id=50357eaeccf2443797b98a3611fba51e, user_id=c54517471c6245ffa52a27d8d33ce1cf, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:47.423408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:47.444324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1107/2227] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:38:47 2022] PUT /identity/v3/projects/50357eaeccf2443797b98a3611fba51e/users/c54517471c6245ffa52a27d8d33ce1cf/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:47.456011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff4704-1ad2-4b03-803c-4a08c4a3b391 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.456301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff4704-1ad2-4b03-803c-4a08c4a3b391 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.456540 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff4704-1ad2-4b03-803c-4a08c4a3b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.484474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2dff4704-1ad2-4b03-803c-4a08c4a3b391 None None] MFA Rules not processed for user `c54517471c6245ffa52a27d8d33ce1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:47.485727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2dff4704-1ad2-4b03-803c-4a08c4a3b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:47.492280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:47.565434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1121/2228] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:47.577475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:47.579444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:47.616642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:47.648795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40b9a-33ad-477c-ba62-8d729649befc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:47.653403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:47.654050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:47.654323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:47.654649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:47.665335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:47.666988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:47.678332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1108/2229] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:48.663691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4624-d865-4b07-8d50-3a9e8ac9ffad None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:48.664234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4624-d865-4b07-8d50-3a9e8ac9ffad None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:48.664234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4624-d865-4b07-8d50-3a9e8ac9ffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:48.685471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f5bc4624-d865-4b07-8d50-3a9e8ac9ffad None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:48.686723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f5bc4624-d865-4b07-8d50-3a9e8ac9ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:48.756021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1122/2230] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:48.777744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:48.779357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:48.856170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7528b6-b47b-4129-ad16-090bcd44d5c1 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:48.866347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:48.866945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:48.867225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:48.867492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:48.877251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:48.878910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:48.889231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1109/2231] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:51.888067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ee33-44be-4fd8-9ccb-4878e56bc162 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:51.888516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ee33-44be-4fd8-9ccb-4878e56bc162 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:51.888716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ee33-44be-4fd8-9ccb-4878e56bc162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:51.908573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7ef9ee33-44be-4fd8-9ccb-4878e56bc162 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:51.909870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7ef9ee33-44be-4fd8-9ccb-4878e56bc162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:51.919035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1123/2232] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:51.942470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:51.955885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa5398-d991-4416-86ae-d01ec6732d85 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:51.961942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:51.962548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:51.962824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:51.963112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:51.971914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:51.973430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:51.983935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1110/2233] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:56.130308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f2cd-6b70-4cb7-84e0-007cf10b18f3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:56.130741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f2cd-6b70-4cb7-84e0-007cf10b18f3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:56.131067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f2cd-6b70-4cb7-84e0-007cf10b18f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:56.153992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-50d1f2cd-6b70-4cb7-84e0-007cf10b18f3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:56.155316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-50d1f2cd-6b70-4cb7-84e0-007cf10b18f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:56.164743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1124/2234] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:38:56.183568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:56.195207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee0e85-c16e-438e-82e0-08391b53161a service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:56.201140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:56.201840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:56.202184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:56.202609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:56.211760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:56.213419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:56.223797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1111/2235] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:58.047088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59872401-8d93-477e-aee0-396db7b3e146 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:58.047582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59872401-8d93-477e-aee0-396db7b3e146 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:58.047701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59872401-8d93-477e-aee0-396db7b3e146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:58.066264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-59872401-8d93-477e-aee0-396db7b3e146 None None] MFA Rules not processed for user `a330928e555a4f1ba17ab73d8c2f2914`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:58.067822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-59872401-8d93-477e-aee0-396db7b3e146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:58.126876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1125/2236] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:58.369769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:58.383926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261977b8-86f2-41e9-947f-6d8a00fd2703 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:58.389162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:58.390142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:58.390424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:58.391381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] PATH_INFO: `/v3/users/c54517471c6245ffa52a27d8d33ce1cf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:58.392606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54517471c6245ffa52a27d8d33ce1cf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:58.394605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:58.448196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54517471c6245ffa52a27d8d33ce1cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:58.448906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54517471c6245ffa52a27d8d33ce1cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:58.456223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54517471c6245ffa52a27d8d33ce1cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:58.466319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54517471c6245ffa52a27d8d33ce1cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:58.466994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54517471c6245ffa52a27d8d33ce1cf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:58.485936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1112/2237] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:38:58 2022] DELETE /identity/v3/users/c54517471c6245ffa52a27d8d33ce1cf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:38:58.490963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:58.491252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:58.491527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:58.511318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:38:58.512601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:58.557999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:58.591255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1126/2238] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:38:58.600599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:58.602139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:58.607816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:38:58.711982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66464cc8-1db6-44cc-9fb2-31004d55dd4b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:58.717082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3947e-d3b1-495b-aeff-39ffc7e6db96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:58.718009 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3947e-d3b1-495b-aeff-39ffc7e6db96 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:58.730881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3947e-d3b1-495b-aeff-39ffc7e6db96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:58.731849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3947e-d3b1-495b-aeff-39ffc7e6db96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:58.749457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3947e-d3b1-495b-aeff-39ffc7e6db96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:58.752824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3947e-d3b1-495b-aeff-39ffc7e6db96 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:58.766585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1113/2239] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:38:59.196586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:38:59.198152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:38:59.215246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398aa2b-0fe9-4d8d-9332-646a4b0fa460 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:38:59.220974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:38:59.222155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:38:59.222626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:38:59.223484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] PATH_INFO: `/v3/projects/50357eaeccf2443797b98a3611fba51e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:38:59.225072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50357eaeccf2443797b98a3611fba51e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:38:59.227825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:38:59.315655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50357eaeccf2443797b98a3611fba51e', 'request_id': 'req-67ea28cb-8a9e-4567-a583-33b622333160'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:59.322275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50357eaeccf2443797b98a3611fba51e', 'request_id': 'req-67ea28cb-8a9e-4567-a583-33b622333160'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:59.328491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50357eaeccf2443797b98a3611fba51e', 'request_id': 'req-67ea28cb-8a9e-4567-a583-33b622333160'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:59.343116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] The token cache is being invalidate because project 50357eaeccf2443797b98a3611fba51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:38:59.343408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:59.344062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:38:59.345604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1127/2240] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:38:59 2022] DELETE /identity/v3/projects/50357eaeccf2443797b98a3611fba51e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:00.353286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:00.353875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:00.353875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:00.374655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:00.375893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:00.444893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1114/2241] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:00.474316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:00.475761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:00.563026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea28cb-8a9e-4567-a583-33b622333160 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:00.569242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:00.570145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:00.570576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:00.571757 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:00.585847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:00.587791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:00.611353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1128/2242] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:06.885498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:06.887494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:06.900368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041ea9-77e3-47e4-a520-5a88fd95b542 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:06.905899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:06.906533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:06.906787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:06.907062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] PATH_INFO: `/v3/users/8a38dec54a464b8a905601b702a36f48` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:06.908229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a38dec54a464b8a905601b702a36f48)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:06.910248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:06.963235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a38dec54a464b8a905601b702a36f48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:06.964197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a38dec54a464b8a905601b702a36f48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:06.972622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a38dec54a464b8a905601b702a36f48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:06.982953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a38dec54a464b8a905601b702a36f48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:06.984482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a38dec54a464b8a905601b702a36f48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.005158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1115/2243] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:39:06 2022] DELETE /identity/v3/users/8a38dec54a464b8a905601b702a36f48 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:07.181491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:07.192004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4346db1-5643-46da-8a52-e4c85bd862a7 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:07.245155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:07.259318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:07.260027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:07.260374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:07.260714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] PATH_INFO: `/v3/projects/47a57ba196ed4aae9df1943b9254b691` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:07.261894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a57ba196ed4aae9df1943b9254b691)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:07.263808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:07.333169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a57ba196ed4aae9df1943b9254b691', 'request_id': 'req-f9951e96-9487-4104-98c3-5fc44931dd47'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.339683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a57ba196ed4aae9df1943b9254b691', 'request_id': 'req-f9951e96-9487-4104-98c3-5fc44931dd47'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.346029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a57ba196ed4aae9df1943b9254b691', 'request_id': 'req-f9951e96-9487-4104-98c3-5fc44931dd47'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.360254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] The token cache is being invalidate because project 47a57ba196ed4aae9df1943b9254b691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:39:07.360426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.360924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.362501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1129/2244] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:39:07 2022] DELETE /identity/v3/projects/47a57ba196ed4aae9df1943b9254b691 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:07.366988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:07.368565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:07.383157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d83734-be14-4ca3-a3d6-3b9faeaa7693 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:07.401002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:07.465102 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:07.465708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:07.466649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:07.466988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] PATH_INFO: `/v3/users/44337b076cef45378a739b92b1f2de48` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:07.468206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44337b076cef45378a739b92b1f2de48)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:07.475754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:07.580115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44337b076cef45378a739b92b1f2de48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.580971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44337b076cef45378a739b92b1f2de48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.589791 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44337b076cef45378a739b92b1f2de48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.605447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44337b076cef45378a739b92b1f2de48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.606557 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5c85d791-4aa7-4209-8344-0845edeac7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44337b076cef45378a739b92b1f2de48'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.627899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1116/2245] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:39:07 2022] DELETE /identity/v3/users/44337b076cef45378a739b92b1f2de48 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:07.834518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:07.836179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:07.850001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9951e96-9487-4104-98c3-5fc44931dd47 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:07.912920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:07.913650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:07.913969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:07.914271 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] PATH_INFO: `/v3/projects/adff27f9b81342d1bfe792a40af04a78` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:07.915462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adff27f9b81342d1bfe792a40af04a78)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:07.917403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:07.968930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adff27f9b81342d1bfe792a40af04a78', 'request_id': 'req-bc3ab4ae-c3de-427e-89fe-2c10c451c273'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.975971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adff27f9b81342d1bfe792a40af04a78', 'request_id': 'req-bc3ab4ae-c3de-427e-89fe-2c10c451c273'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.982842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adff27f9b81342d1bfe792a40af04a78', 'request_id': 'req-bc3ab4ae-c3de-427e-89fe-2c10c451c273'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.997517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] The token cache is being invalidate because project adff27f9b81342d1bfe792a40af04a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:39:07.997858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:07.998510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc3ab4ae-c3de-427e-89fe-2c10c451c273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:08.000096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1130/2246] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:39:07 2022] DELETE /identity/v3/projects/adff27f9b81342d1bfe792a40af04a78 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:08.005202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1cd3-15fe-44b9-a8af-1b409c4eb5bf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.005745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1cd3-15fe-44b9-a8af-1b409c4eb5bf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.005853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1cd3-15fe-44b9-a8af-1b409c4eb5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.026173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-26ec1cd3-15fe-44b9-a8af-1b409c4eb5bf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:08.027394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26ec1cd3-15fe-44b9-a8af-1b409c4eb5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:08.101053 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1117/2247] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:08.110043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4dfe-01fe-4714-957d-0d9c7a63be3c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.110308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4dfe-01fe-4714-957d-0d9c7a63be3c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.110573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4dfe-01fe-4714-957d-0d9c7a63be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.130829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b83a4dfe-01fe-4714-957d-0d9c7a63be3c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:08.132057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b83a4dfe-01fe-4714-957d-0d9c7a63be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:08.140815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1131/2248] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:08.145133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1cd3-15fe-44b9-a8af-1b409c4eb5bf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.155171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1cd3-15fe-44b9-a8af-1b409c4eb5bf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.160157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.160771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.161048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.161316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.161995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:39:08.162298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.163941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.176352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1118/2249] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:39:08.180749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a4dfe-01fe-4714-957d-0d9c7a63be3c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.185210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:08.191619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a4dfe-01fe-4714-957d-0d9c7a63be3c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.198205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.198825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.199105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.199379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.200035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.201977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.234370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1132/2250] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:39:08 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:39:08.235470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.246332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3b2f-55d9-4ac6-966b-7091a27be373 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.269062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:08.307138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.307732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.308008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.308276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.308912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.311156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.334873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1119/2251] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:39:08 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:39:08.339436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.350851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dcdf2-4514-4b5d-b2a5-0190bcf2867e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.356407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.357010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.357285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.357573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.358250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.359831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.370851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1133/2252] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:39:08.375181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.389291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0bcb0-04b4-4433-9066-9612fd0defb3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.395105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69278ad-00e6-4331-bb7f-b99b7dd53b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.395724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69278ad-00e6-4331-bb7f-b99b7dd53b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.396004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69278ad-00e6-4331-bb7f-b99b7dd53b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.396273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69278ad-00e6-4331-bb7f-b99b7dd53b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.396925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69278ad-00e6-4331-bb7f-b99b7dd53b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.398554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69278ad-00e6-4331-bb7f-b99b7dd53b69 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.409943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1120/2253] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:39:08.414633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.425022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d4e78-3122-4c6f-b31d-e21551bfb02a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.430095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.430624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.430903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.431173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] PATH_INFO: `/v3/projects/69a18a01f6644fabba4c638baa597f38/users/3338c82d60af4134a3a4acd29b130c8a/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.446241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a18a01f6644fabba4c638baa597f38, user_id=3338c82d60af4134a3a4acd29b130c8a, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.448893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.462867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1134/2254] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:39:08 2022] PUT /identity/v3/projects/69a18a01f6644fabba4c638baa597f38/users/3338c82d60af4134a3a4acd29b130c8a/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:08.532386 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144de74b-74b6-4e13-a68d-7d0f9f142f6b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.532663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144de74b-74b6-4e13-a68d-7d0f9f142f6b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.532957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144de74b-74b6-4e13-a68d-7d0f9f142f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.562608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-144de74b-74b6-4e13-a68d-7d0f9f142f6b None None] MFA Rules not processed for user `3338c82d60af4134a3a4acd29b130c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:08.563835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-144de74b-74b6-4e13-a68d-7d0f9f142f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:08.631077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1121/2255] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:39:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:08.646172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.647954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:08.707876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ad643-d04b-4e04-8905-fd25dfdac657 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.711902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead5b67-21de-4910-9461-91bd908139ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.712508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5b67-21de-4910-9461-91bd908139ab service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.712785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5b67-21de-4910-9461-91bd908139ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.713051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5b67-21de-4910-9461-91bd908139ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.721790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead5b67-21de-4910-9461-91bd908139ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.723388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead5b67-21de-4910-9461-91bd908139ab service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.735458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1135/2256] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:08.759637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144de74b-74b6-4e13-a68d-7d0f9f142f6b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:08.831409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144de74b-74b6-4e13-a68d-7d0f9f142f6b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:08.836126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:08.836801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.837137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.837374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] PATH_INFO: `/v3/users/3338c82d60af4134a3a4acd29b130c8a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.838589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3338c82d60af4134a3a4acd29b130c8a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:08.840578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:08.885167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:08.897139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3338c82d60af4134a3a4acd29b130c8a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:08.897966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3338c82d60af4134a3a4acd29b130c8a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:08.904936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3338c82d60af4134a3a4acd29b130c8a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:08.913489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3338c82d60af4134a3a4acd29b130c8a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:08.914127 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3338c82d60af4134a3a4acd29b130c8a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:08.931085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1122/2257] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:39:08 2022] DELETE /identity/v3/users/3338c82d60af4134a3a4acd29b130c8a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:08.935684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:08.935964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:08.936232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:08.955315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:08.956497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:09.018396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1136/2258] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:09.028770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:09.030319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:09.089252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fc61b-8f76-4c90-abc0-25a817040ff2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:09.093016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84836f-3237-4305-934b-8f085a8673c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:09.093656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84836f-3237-4305-934b-8f085a8673c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:09.093934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84836f-3237-4305-934b-8f085a8673c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:09.094200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84836f-3237-4305-934b-8f085a8673c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:09.103834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84836f-3237-4305-934b-8f085a8673c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:09.105350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84836f-3237-4305-934b-8f085a8673c2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:09.116103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1123/2259] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:09.394868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:09.396963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:09.409643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedd37e-b6e8-449d-aeaa-d5538c3fe77c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:09.415484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:09.416481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:09.416829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:09.417115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] PATH_INFO: `/v3/projects/69a18a01f6644fabba4c638baa597f38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:09.418388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a18a01f6644fabba4c638baa597f38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:09.421260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:09.473137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:09.477486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a18a01f6644fabba4c638baa597f38', 'request_id': 'req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:09.486616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a18a01f6644fabba4c638baa597f38', 'request_id': 'req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:09.492849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a18a01f6644fabba4c638baa597f38', 'request_id': 'req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:09.506927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] The token cache is being invalidate because project 69a18a01f6644fabba4c638baa597f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:39:09.507508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:09.508369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:39:09.509911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1137/2260] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:39:09 2022] DELETE /identity/v3/projects/69a18a01f6644fabba4c638baa597f38 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:39:13.052652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa15c-0e20-4db7-a41a-03d9cb3402f3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:13.053257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa15c-0e20-4db7-a41a-03d9cb3402f3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:13.053257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efa15c-0e20-4db7-a41a-03d9cb3402f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:13.072978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-93efa15c-0e20-4db7-a41a-03d9cb3402f3 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:13.074238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-93efa15c-0e20-4db7-a41a-03d9cb3402f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:13.141849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1124/2261] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:39:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:13.155390 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:13.157123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:13.245103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec51c7f-c0cc-45eb-b01d-c68c2621f90d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:13.252950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0dcf7-d9d0-494d-8160-d4c61c393f91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:13.253606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0dcf7-d9d0-494d-8160-d4c61c393f91 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:13.253881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0dcf7-d9d0-494d-8160-d4c61c393f91 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:13.254140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0dcf7-d9d0-494d-8160-d4c61c393f91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:13.263841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0dcf7-d9d0-494d-8160-d4c61c393f91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:13.265738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0dcf7-d9d0-494d-8160-d4c61c393f91 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:13.279543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1138/2262] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:39:20.707295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec99c8-9313-4679-9640-9e960b9d05d1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:20.707893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec99c8-9313-4679-9640-9e960b9d05d1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:20.707893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec99c8-9313-4679-9640-9e960b9d05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:20.729013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-99ec99c8-9313-4679-9640-9e960b9d05d1 None None] MFA Rules not processed for user `43725f0b6e274ed4bfd5e817d10370e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:20.731212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99ec99c8-9313-4679-9640-9e960b9d05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:20.795439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1125/2263] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:39:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:23.271877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=40,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:24.044134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9ee2-5c06-4a8a-8e41-9213f161cbed None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:24.044920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9ee2-5c06-4a8a-8e41-9213f161cbed None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:24.046018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a9ee2-5c06-4a8a-8e41-9213f161cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:24.070237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-218a9ee2-5c06-4a8a-8e41-9213f161cbed None None] MFA Rules not processed for user `36cfdf71cf0b461894bb514c16032227`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:24.071804 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-218a9ee2-5c06-4a8a-8e41-9213f161cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:24.145620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1139/2264] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:39:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:29.125276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de612a1-d22f-4f93-8e72-8f09a42b8232 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:29.126352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de612a1-d22f-4f93-8e72-8f09a42b8232 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:29.126843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de612a1-d22f-4f93-8e72-8f09a42b8232 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:29.128704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1126/2265] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:39:29.135282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fddf-6e74-4ecf-84db-afd568a662cd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:29.135847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fddf-6e74-4ecf-84db-afd568a662cd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:29.135847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fddf-6e74-4ecf-84db-afd568a662cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:29.180746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c393fddf-6e74-4ecf-84db-afd568a662cd None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:29.182019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c393fddf-6e74-4ecf-84db-afd568a662cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:29.285250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1140/2266] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:29.298435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de612a1-d22f-4f93-8e72-8f09a42b8232 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:29.300508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9de612a1-d22f-4f93-8e72-8f09a42b8232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:29.307061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:29.405810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de612a1-d22f-4f93-8e72-8f09a42b8232 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:29.409330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50052a-59a7-4353-a1e8-7571ebb2157f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3160eee18a4f7cb9f6880ec1b672a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:29.409968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50052a-59a7-4353-a1e8-7571ebb2157f service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:29.410245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50052a-59a7-4353-a1e8-7571ebb2157f service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:29.410513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50052a-59a7-4353-a1e8-7571ebb2157f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:29.420522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50052a-59a7-4353-a1e8-7571ebb2157f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:29.422038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50052a-59a7-4353-a1e8-7571ebb2157f service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:29.432611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1127/2267] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:29.506469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc35da-eb0a-47e7-b2e0-0232ea5d682f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:29.506758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc35da-eb0a-47e7-b2e0-0232ea5d682f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:29.507032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc35da-eb0a-47e7-b2e0-0232ea5d682f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:29.508802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1141/2268] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:39:29.513678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb62cb3-3a81-44eb-9beb-2cef99fd83c9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:29.513965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb62cb3-3a81-44eb-9beb-2cef99fd83c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:29.514240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb62cb3-3a81-44eb-9beb-2cef99fd83c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:29.542362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-feb62cb3-3a81-44eb-9beb-2cef99fd83c9 None None] MFA Rules not processed for user `77470d4430f04d30b64297de78e67f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:29.543606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-feb62cb3-3a81-44eb-9beb-2cef99fd83c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:29.606635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1128/2269] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:39:29.623727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc35da-eb0a-47e7-b2e0-0232ea5d682f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:29.628267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-31cc35da-eb0a-47e7-b2e0-0232ea5d682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:29.660543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc35da-eb0a-47e7-b2e0-0232ea5d682f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:29.666958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8d602-e671-42c8-8240-8002ce6a6096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:29.668562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d602-e671-42c8-8240-8002ce6a6096 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:29.669117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d602-e671-42c8-8240-8002ce6a6096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:29.669583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d602-e671-42c8-8240-8002ce6a6096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:29.688364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8d602-e671-42c8-8240-8002ce6a6096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:29.690434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8d602-e671-42c8-8240-8002ce6a6096 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:29.701214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1142/2270] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:30.149905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0097a7-350f-4f4a-9276-be330876d297 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:30.150412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0097a7-350f-4f4a-9276-be330876d297 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:30.150412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0097a7-350f-4f4a-9276-be330876d297 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:30.151777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1129/2271] 10.222.0.42 () {54 vars in 921 bytes} [Tue Aug 30 00:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:39:30.157588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b9d96-57a5-4f14-9cee-216a4afc2e0b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:30.158049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b9d96-57a5-4f14-9cee-216a4afc2e0b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:30.158338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b9d96-57a5-4f14-9cee-216a4afc2e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:30.181338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7f5b9d96-57a5-4f14-9cee-216a4afc2e0b None None] MFA Rules not processed for user `aa4e1f12814a4923a2a37d771c59d40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:30.182637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7f5b9d96-57a5-4f14-9cee-216a4afc2e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:30.193305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1143/2272] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Aug 30 00:39:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:30.204238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0097a7-350f-4f4a-9276-be330876d297 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:30.206192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c0097a7-350f-4f4a-9276-be330876d297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:30.219789 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0097a7-350f-4f4a-9276-be330876d297 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:30.224293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:30.224899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:30.225175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:30.226509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:30.238165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:30.240008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:30.251517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1130/2273] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:35.046834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676309a-b48a-4bd3-b5d8-a068f709e927 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:35.047346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676309a-b48a-4bd3-b5d8-a068f709e927 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:35.047346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676309a-b48a-4bd3-b5d8-a068f709e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:35.066492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d676309a-b48a-4bd3-b5d8-a068f709e927 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:35.067704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d676309a-b48a-4bd3-b5d8-a068f709e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:35.075857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1144/2274] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:39:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:35.087851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:35.100374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e94c-d1af-43dd-99db-b6f5bd9ce993 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:35.106578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:35.107136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:35.107357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:35.107817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:35.117142 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:35.118858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:35.127369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1131/2275] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:39:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:39:45.061261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=68 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:45.123835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=68 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:39:52.961831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697436a-ace3-4a73-9500-601e75c1fdc0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:52.962403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697436a-ace3-4a73-9500-601e75c1fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:52.962403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697436a-ace3-4a73-9500-601e75c1fdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:52.984392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4697436a-ace3-4a73-9500-601e75c1fdc0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:52.985628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4697436a-ace3-4a73-9500-601e75c1fdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:53.064273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1145/2276] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:53.090562 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:53.093088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:53.112339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f50eb-eead-49e1-bb2f-393bc8a96db5 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:53.118704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:53.119563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:53.119839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:53.120109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:53.130221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:53.131861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:53.142115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1132/2277] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:57.309983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e670017-42f7-4854-a38e-708a3ae24af8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:57.310557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e670017-42f7-4854-a38e-708a3ae24af8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:57.310557 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e670017-42f7-4854-a38e-708a3ae24af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:57.331512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2e670017-42f7-4854-a38e-708a3ae24af8 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:57.332733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2e670017-42f7-4854-a38e-708a3ae24af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:57.341522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1146/2278] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:57.362088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:57.374198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35437d64-2297-472b-a651-4450933dbd13 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:57.380484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:57.381082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:57.381329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:57.381624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:57.391033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:57.392894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:57.402975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1133/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:39:57.960586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776b29-d610-4ca8-937d-891116e18aa0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:57.960866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776b29-d610-4ca8-937d-891116e18aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:57.961119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776b29-d610-4ca8-937d-891116e18aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:57.983589 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-98776b29-d610-4ca8-937d-891116e18aa0 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:39:57.984792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-98776b29-d610-4ca8-937d-891116e18aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:39:57.993475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1147/2280] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 30 00:39:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:39:58.016279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:39:58.027973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff762d-333f-4859-8d5f-6873c3fb27d0 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:39:58.033168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b1d61-3f91-4a05-bf12-f13a2b957a81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:39:58.033831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b1d61-3f91-4a05-bf12-f13a2b957a81 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:39:58.034107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b1d61-3f91-4a05-bf12-f13a2b957a81 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:39:58.034374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b1d61-3f91-4a05-bf12-f13a2b957a81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:39:58.042792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b1d61-3f91-4a05-bf12-f13a2b957a81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:39:58.044419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b1d61-3f91-4a05-bf12-f13a2b957a81 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:39:58.052606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1134/2281] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:39:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:40:00.537233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e373-1e19-4d52-bae6-d98b5ea091c5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:00.537724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e373-1e19-4d52-bae6-d98b5ea091c5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:00.537881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7e373-1e19-4d52-bae6-d98b5ea091c5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:00.539394 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1148/2282] 10.222.0.42 () {54 vars in 961 bytes} [Tue Aug 30 00:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:40:00.544606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da0ab-826f-4f51-9e68-140157ff6202 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:00.545107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da0ab-826f-4f51-9e68-140157ff6202 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:00.545209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3da0ab-826f-4f51-9e68-140157ff6202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:00.565491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ba3da0ab-826f-4f51-9e68-140157ff6202 None None] MFA Rules not processed for user `ab238ea3e0614e92a53cda1b0fc413f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:00.566729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ba3da0ab-826f-4f51-9e68-140157ff6202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:00.631778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1135/2283] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Aug 30 00:40:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:00.639595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7e373-1e19-4d52-bae6-d98b5ea091c5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:00.654193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7e373-1e19-4d52-bae6-d98b5ea091c5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:00.659471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:00.660061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:00.660340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:00.660608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:00.662510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:00.674052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:00.675646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:00.685459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1149/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:40:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:40:01.397173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586ba98-2af6-46d4-887f-7d1f04aadbea None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:01.397467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586ba98-2af6-46d4-887f-7d1f04aadbea None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:01.397785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586ba98-2af6-46d4-887f-7d1f04aadbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:01.418334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6586ba98-2af6-46d4-887f-7d1f04aadbea None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:01.419551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6586ba98-2af6-46d4-887f-7d1f04aadbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:01.427998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1136/2285] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:01.453796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:01.455984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:01.472937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a033-14a1-499d-b84e-a30e4ac7148f service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:01.480262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:01.480873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:01.481177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:01.481446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:01.491097 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:01.492686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:01.502203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1150/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:40:05.600372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdfb10-30ff-48c6-8e1a-4241c86b95c9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:05.600902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdfb10-30ff-48c6-8e1a-4241c86b95c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:05.600902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdfb10-30ff-48c6-8e1a-4241c86b95c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:05.622416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-03fdfb10-30ff-48c6-8e1a-4241c86b95c9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:05.623715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-03fdfb10-30ff-48c6-8e1a-4241c86b95c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:05.632891 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1137/2287] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:05.653565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:05.664867 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b280d-abce-4f53-8f45-d78bf2c0f82e service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:05.670629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:05.671258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:05.671535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:05.671792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:05.680687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:05.682560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:05.692610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1151/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:40:10.847420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7bb7-6ca5-42ed-8684-cdf07e9ddeb0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:10.848044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7bb7-6ca5-42ed-8684-cdf07e9ddeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:10.848044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7bb7-6ca5-42ed-8684-cdf07e9ddeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:10.869192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-59ed7bb7-6ca5-42ed-8684-cdf07e9ddeb0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:10.870579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-59ed7bb7-6ca5-42ed-8684-cdf07e9ddeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:10.881453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1138/2289] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Aug 30 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:10.900731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:10.912184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f488d-3dc6-432c-ac77-50e9de18224e service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:10.918018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:10.918649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:10.918924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:10.919190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:10.928806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:10.930424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:10.940573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1152/2290] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:40:20.862661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=56 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:40:20.936252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=57 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:40:27.557052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bedf2-91e7-4e50-8ee5-ef826ac86140 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:27.557604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bedf2-91e7-4e50-8ee5-ef826ac86140 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:27.557604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bedf2-91e7-4e50-8ee5-ef826ac86140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:27.577116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bc2bedf2-91e7-4e50-8ee5-ef826ac86140 None None] MFA Rules not processed for user `a330928e555a4f1ba17ab73d8c2f2914`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:27.579547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc2bedf2-91e7-4e50-8ee5-ef826ac86140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:27.641781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1139/2291] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:40:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:37.635111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=25 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:40:42.084909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:42.086572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:42.100152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d525af-4091-4f64-85fd-6e99da19d2d8 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:42.106426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:42.107094 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.107375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.107646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] PATH_INFO: `/v3/users/43725f0b6e274ed4bfd5e817d10370e7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.108767 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] RBAC: Authorizing `identity:delete_user(user_id=43725f0b6e274ed4bfd5e817d10370e7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:42.110732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:42.160727 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43725f0b6e274ed4bfd5e817d10370e7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.173106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43725f0b6e274ed4bfd5e817d10370e7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.180780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43725f0b6e274ed4bfd5e817d10370e7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.181504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43725f0b6e274ed4bfd5e817d10370e7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.182141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2eee6f33-2925-4f9f-96e5-7ccc31c0609d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43725f0b6e274ed4bfd5e817d10370e7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.198841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1153/2292] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:40:42 2022] DELETE /identity/v3/users/43725f0b6e274ed4bfd5e817d10370e7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:40:42.389184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bedf2-91e7-4e50-8ee5-ef826ac86140 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:42.402262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bedf2-91e7-4e50-8ee5-ef826ac86140 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:42.458873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:42.459537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.459811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.460077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] PATH_INFO: `/v3/projects/756dd24099fc44d7948e889bb4bfc542` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.461179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=756dd24099fc44d7948e889bb4bfc542)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:42.463144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:42.521925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756dd24099fc44d7948e889bb4bfc542', 'request_id': 'req-50124535-c9fb-46a9-8622-1811a125c0fa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.527952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756dd24099fc44d7948e889bb4bfc542', 'request_id': 'req-50124535-c9fb-46a9-8622-1811a125c0fa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.537282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756dd24099fc44d7948e889bb4bfc542', 'request_id': 'req-50124535-c9fb-46a9-8622-1811a125c0fa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.549452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] The token cache is being invalidate because project 756dd24099fc44d7948e889bb4bfc542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:40:42.549771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.550419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50124535-c9fb-46a9-8622-1811a125c0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:40:42.551922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1140/2293] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:40:42 2022] DELETE /identity/v3/projects/756dd24099fc44d7948e889bb4bfc542 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:40:42.557895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0511db2-274b-42bd-ac84-c92fe7c687be None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.558179 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0511db2-274b-42bd-ac84-c92fe7c687be None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.558495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0511db2-274b-42bd-ac84-c92fe7c687be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.579334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a0511db2-274b-42bd-ac84-c92fe7c687be None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:42.580586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a0511db2-274b-42bd-ac84-c92fe7c687be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:42.655878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1154/2294] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:42.664419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089eb57-8103-40c1-9b7d-1cfa02ae8ed7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.664723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089eb57-8103-40c1-9b7d-1cfa02ae8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.664984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089eb57-8103-40c1-9b7d-1cfa02ae8ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.689303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9089eb57-8103-40c1-9b7d-1cfa02ae8ed7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:42.690611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9089eb57-8103-40c1-9b7d-1cfa02ae8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:42.699220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1141/2295] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:42.704261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0511db2-274b-42bd-ac84-c92fe7c687be None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:42.714658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0511db2-274b-42bd-ac84-c92fe7c687be None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:42.720357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:42.721107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.721383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.721665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.722317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:40:42.722610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:42.724231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:42.738360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1155/2296] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:40:42.742875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089eb57-8103-40c1-9b7d-1cfa02ae8ed7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:42.753523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089eb57-8103-40c1-9b7d-1cfa02ae8ed7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:42.758878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:42.759589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.760016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.760294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.761024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:42.763032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:42.797526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1142/2297] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:40:42 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:40:42.801716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:42.812240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3694d-e4ac-4fa1-9072-0cbec5f0e1c2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:42.873934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:42.874558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.874836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.875105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.875829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:42.877827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:42.886945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:40:42.903921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1156/2298] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:40:42 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:40:42.908522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:42.922377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534349cd-3cd0-41a2-9294-b3fe0f738e27 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:42.928895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:42.929511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.929914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.930212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.931078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:42.933004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:42.948449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1143/2299] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:40:42.953125 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:42.964955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445540-2d8b-4ed4-8795-0d3cebc2d4b1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:42.975280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444d6a7-1fc9-433f-9732-71fd13571efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:42.975934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d6a7-1fc9-433f-9732-71fd13571efc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:42.976214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d6a7-1fc9-433f-9732-71fd13571efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:42.976489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d6a7-1fc9-433f-9732-71fd13571efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:42.977140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444d6a7-1fc9-433f-9732-71fd13571efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:42.978783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444d6a7-1fc9-433f-9732-71fd13571efc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:42.990880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1157/2300] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:40:42.995045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:43.007617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c746e1-5c70-41d4-bdbb-535bfe48f214 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:43.013518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:43.014331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:43.014696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:43.015036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] PATH_INFO: `/v3/projects/3361709f899a4f99a88e3e694e0e4737/users/dda5f49a1f49429f882ecbf6911a483e/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:43.030926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3361709f899a4f99a88e3e694e0e4737, user_id=dda5f49a1f49429f882ecbf6911a483e, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:43.033928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:43.047917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1144/2301] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:40:42 2022] PUT /identity/v3/projects/3361709f899a4f99a88e3e694e0e4737/users/dda5f49a1f49429f882ecbf6911a483e/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:40:43.052774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0266aa-f204-4255-bcad-1dc58307c8b0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:43.053360 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0266aa-f204-4255-bcad-1dc58307c8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:43.053650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0266aa-f204-4255-bcad-1dc58307c8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:43.073738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fe0266aa-f204-4255-bcad-1dc58307c8b0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:43.074949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fe0266aa-f204-4255-bcad-1dc58307c8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:43.138096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1158/2302] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:43.147948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:43.149822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:43.180530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:40:43.223753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651eeb4-67b0-4476-a167-8a7d5bf6acdb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:43.227678 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:43.228289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:43.228569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:43.228842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:43.238954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:43.244054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:43.254962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1145/2303] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:40:48.324078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4f18-61d5-473c-9375-f727a77a3859 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:48.324549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4f18-61d5-473c-9375-f727a77a3859 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:48.324746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4f18-61d5-473c-9375-f727a77a3859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:48.354936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-59ce4f18-61d5-473c-9375-f727a77a3859 None None] MFA Rules not processed for user `dda5f49a1f49429f882ecbf6911a483e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:48.356158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-59ce4f18-61d5-473c-9375-f727a77a3859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:48.431993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1159/2304] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:40:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:48.436655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:48.446956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95998b33-dbe7-4a1c-a114-001c76c4467e service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:48.451973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:48.452644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:48.452929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:48.453196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:48.453881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:48.455940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:48.487087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1146/2305] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:40:48 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:40:48.492565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4f18-61d5-473c-9375-f727a77a3859 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:48.503884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4f18-61d5-473c-9375-f727a77a3859 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:48.563514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:48.564151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:48.564458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:48.564724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:48.565366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:48.568052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:48.587527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:40:48.597704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1160/2306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:40:48 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:40:48.602945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:48.618323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c77e28-2915-483a-aee1-758d511b1441 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:48.624838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:48.625510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:48.625908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:48.626241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:48.626983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:48.628686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:48.644667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1147/2307] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:40:48.648957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:48.660131 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949394cd-f55c-4d29-ae0a-eef58f266545 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:48.664928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:48.665629 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:48.665908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:48.666178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] PATH_INFO: `/v3/projects/3e18dbec9ee44c84ac4a19667d91b336/users/316ad3bd299e4e6c9ce51b1bf6073dff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:48.683002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e18dbec9ee44c84ac4a19667d91b336, user_id=316ad3bd299e4e6c9ce51b1bf6073dff, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:48.685741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:48.712267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1161/2308] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:40:48 2022] PUT /identity/v3/projects/3e18dbec9ee44c84ac4a19667d91b336/users/316ad3bd299e4e6c9ce51b1bf6073dff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:40:48.719189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:48.738758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f802-2648-44e7-9a29-2906988ea35f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:48.814482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e2096-27fb-49a6-a594-fab7aafca85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:48.815318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e2096-27fb-49a6-a594-fab7aafca85b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:48.815644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e2096-27fb-49a6-a594-fab7aafca85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:48.815912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e2096-27fb-49a6-a594-fab7aafca85b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:48.816709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e2096-27fb-49a6-a594-fab7aafca85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:48.818386 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e2096-27fb-49a6-a594-fab7aafca85b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:48.830963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1148/2309] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:40:48.835421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:48.853860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930077d-f494-4a5d-915a-c8bb16af8f6d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:48.860312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b7006-bc1f-455a-9581-7281c18d1ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:48.861320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b7006-bc1f-455a-9581-7281c18d1ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:48.861831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b7006-bc1f-455a-9581-7281c18d1ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:48.862296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b7006-bc1f-455a-9581-7281c18d1ba0 admin admin] PATH_INFO: `/v3/projects/3e18dbec9ee44c84ac4a19667d91b336/users/316ad3bd299e4e6c9ce51b1bf6073dff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:48.866513 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b7006-bc1f-455a-9581-7281c18d1ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e18dbec9ee44c84ac4a19667d91b336, user_id=316ad3bd299e4e6c9ce51b1bf6073dff, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:48.870680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b7006-bc1f-455a-9581-7281c18d1ba0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:48.904366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1162/2310] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:40:48 2022] PUT /identity/v3/projects/3e18dbec9ee44c84ac4a19667d91b336/users/316ad3bd299e4e6c9ce51b1bf6073dff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:40:51.178793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:51.179378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:51.179378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:51.199466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] MFA Rules not processed for user `2532defc863d4fbe8885c6f38169b5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:51.200812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:51.265188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1149/2311] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:40:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:54.466382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38414a-98a3-4cfd-8082-3ccd5050311a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:54.466931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38414a-98a3-4cfd-8082-3ccd5050311a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:54.467126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38414a-98a3-4cfd-8082-3ccd5050311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:54.513817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5d38414a-98a3-4cfd-8082-3ccd5050311a None None] MFA Rules not processed for user `316ad3bd299e4e6c9ce51b1bf6073dff`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:54.515918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5d38414a-98a3-4cfd-8082-3ccd5050311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:54.601918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1163/2312] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:54.614625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:54.616216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:54.675574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:40:54.710287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bd701-a879-45d5-bda5-f042b2a61e73 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:54.714570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3160eee18a4f7cb9f6880ec1b672a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:54.715246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:54.715707 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:54.715979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:54.791516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:54.794099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:54.817786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1150/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:40:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:40:54.975610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeddbf4-f950-4bc8-a46d-fdb26c132ff1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:54.976108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeddbf4-f950-4bc8-a46d-fdb26c132ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:54.976533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeddbf4-f950-4bc8-a46d-fdb26c132ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:54.998969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ceeddbf4-f950-4bc8-a46d-fdb26c132ff1 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:40:55.000253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ceeddbf4-f950-4bc8-a46d-fdb26c132ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:55.095092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1164/2314] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:40:55.102936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:40:55.104409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:40:55.257162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964433c-12ba-44fe-ab9b-3258c93d073b service glance] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:40:55.263501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e9cdd-38fd-4347-9aab-7ad81eff90cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:40:55.264629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e9cdd-38fd-4347-9aab-7ad81eff90cc service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:40:55.265083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e9cdd-38fd-4347-9aab-7ad81eff90cc service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:40:55.265361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e9cdd-38fd-4347-9aab-7ad81eff90cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:40:55.274844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e9cdd-38fd-4347-9aab-7ad81eff90cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:40:55.277034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e9cdd-38fd-4347-9aab-7ad81eff90cc service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:40:55.286620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1151/2315] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:41:04.852344 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5d33-81a1-46c7-9aa7-c241f94048f9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:04.852801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5d33-81a1-46c7-9aa7-c241f94048f9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:04.852949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5d33-81a1-46c7-9aa7-c241f94048f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:04.874358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dc4a5d33-81a1-46c7-9aa7-c241f94048f9 None None] MFA Rules not processed for user `36cfdf71cf0b461894bb514c16032227`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:41:04.875562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc4a5d33-81a1-46c7-9aa7-c241f94048f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:04.925605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:41:04.936854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1165/2316] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:41:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:41:04.979970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80bf90-b78c-4e70-a790-987e9c9641a1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:04.980466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80bf90-b78c-4e70-a790-987e9c9641a1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:04.980667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80bf90-b78c-4e70-a790-987e9c9641a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:05.002960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cc80bf90-b78c-4e70-a790-987e9c9641a1 None None] MFA Rules not processed for user `dda5f49a1f49429f882ecbf6911a483e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:41:05.004702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cc80bf90-b78c-4e70-a790-987e9c9641a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:05.015573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1152/2317] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:41:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:41:09.598026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75c6b4-11dc-4eb9-a135-33622d3973cc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:09.598535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75c6b4-11dc-4eb9-a135-33622d3973cc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:09.598617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75c6b4-11dc-4eb9-a135-33622d3973cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:09.618956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fb75c6b4-11dc-4eb9-a135-33622d3973cc None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:41:09.620262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fb75c6b4-11dc-4eb9-a135-33622d3973cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:09.630119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1166/2318] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:41:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:41:09.643954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80bf90-b78c-4e70-a790-987e9c9641a1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:41:09.668871 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80bf90-b78c-4e70-a790-987e9c9641a1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:41:09.675181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c724d-0d43-4651-9abe-89f2d82f3123 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:41:09.675796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c724d-0d43-4651-9abe-89f2d82f3123 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:09.676293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c724d-0d43-4651-9abe-89f2d82f3123 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:09.676554 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c724d-0d43-4651-9abe-89f2d82f3123 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:09.694399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c724d-0d43-4651-9abe-89f2d82f3123 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:41:09.696115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c724d-0d43-4651-9abe-89f2d82f3123 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:41:09.723349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1153/2319] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:41:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:41:19.613434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:41:19.701815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=72 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:41:24.520322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29810a9b-d547-4fd1-98aa-db711a13711d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:24.520865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29810a9b-d547-4fd1-98aa-db711a13711d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:24.520865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29810a9b-d547-4fd1-98aa-db711a13711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:24.541298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-29810a9b-d547-4fd1-98aa-db711a13711d None None] MFA Rules not processed for user `d8876e2cba404244b731450ff5112c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:41:24.542454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-29810a9b-d547-4fd1-98aa-db711a13711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:24.629486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1167/2320] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:41:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:41:34.607016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=25 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:41:34.826031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9d66-c476-4a21-b85a-10f1597c3934 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:34.826538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9d66-c476-4a21-b85a-10f1597c3934 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:34.826654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f9d66-c476-4a21-b85a-10f1597c3934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:34.848473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e31f9d66-c476-4a21-b85a-10f1597c3934 None None] MFA Rules not processed for user `a330928e555a4f1ba17ab73d8c2f2914`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:41:34.849716 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e31f9d66-c476-4a21-b85a-10f1597c3934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:34.906175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1154/2321] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:41:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:41:34.970715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29810a9b-d547-4fd1-98aa-db711a13711d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:41:35.031447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29810a9b-d547-4fd1-98aa-db711a13711d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:41:35.035481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:41:35.036189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:35.036467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:35.036732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:35.046040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:41:35.047471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:41:35.056833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1168/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:41:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:41:44.899169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=25 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:41:45.053259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=26 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:41:53.718294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f9d66-c476-4a21-b85a-10f1597c3934 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:41:53.728173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f9d66-c476-4a21-b85a-10f1597c3934 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:41:53.732248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:41:53.732845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:53.733120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:53.733381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:53.735448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:53.814970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:41:53.816417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:41:53.827540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1155/2323] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:41:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:41:54.398143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:41:54.400111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:54.473063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64bc0-0e26-4ed1-951a-f4ed067c5cbc service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:41:54.477607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:41:54.478232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:54.478504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:54.478764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:54.480521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:54.496883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:41:54.498376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:41:54.509246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1169/2324] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:41:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:41:59.721841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:41:59.723573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:59.738762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d78601-bc85-4dd9-8c26-9e7c7eae5d19 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:41:59.745575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:41:59.746195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:41:59.746470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:41:59.746731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:41:59.748737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:41:59.760321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:41:59.761979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:41:59.771319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1156/2325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:41:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:04.504370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=26 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:09.766941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=40 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:17.188445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:17.206256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cfc49-749d-401f-af57-834b83ad4073 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:17.212938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b1218-499b-4673-b56d-23b2de1bb24d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:17.213538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1218-499b-4673-b56d-23b2de1bb24d service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:17.213845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1218-499b-4673-b56d-23b2de1bb24d service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:17.214118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1218-499b-4673-b56d-23b2de1bb24d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:17.216155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-661b1218-499b-4673-b56d-23b2de1bb24d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:17.227304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b1218-499b-4673-b56d-23b2de1bb24d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:17.228885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b1218-499b-4673-b56d-23b2de1bb24d service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:17.238312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1170/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:17.283441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:17.293583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37370769-088a-4b12-bef8-7052f9c8bcd1 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:17.297812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:17.298414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:17.298692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:17.298945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:17.300971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:17.372082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:17.373584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:17.383939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1157/2327] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:18.809923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:18.810436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:18.810527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:18.833022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:18.834296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:18.842355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1171/2328] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:42:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:18.885840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:18.898289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cdc0e-8678-4a71-875b-baa331219e22 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:18.904274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:18.904902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:18.905256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:18.905617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:18.915764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:18.917507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:18.927005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1158/2329] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:42:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:42:21.268293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:21.270455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:21.350223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:21.354577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:21.355292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7c460-7049-4edd-ba7e-688f245efe63 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:21.371995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:21.373157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:21.373445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:21.373749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:21.377514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:21.387514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02790678-4f6b-43d1-b256-f598df8d9831 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:21.395948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:21.396931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:21.397374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:21.397884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] PATH_INFO: `/v3/users/36cfdf71cf0b461894bb514c16032227` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:21.399207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cfdf71cf0b461894bb514c16032227)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:21.401360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:21.404786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:21.406432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:21.431338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1172/2330] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:21.487462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cfdf71cf0b461894bb514c16032227'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:21.488295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cfdf71cf0b461894bb514c16032227'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:21.497189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cfdf71cf0b461894bb514c16032227'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:21.510369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cfdf71cf0b461894bb514c16032227'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:21.511795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9bb310c8-01b6-4c81-8996-41257eb18930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cfdf71cf0b461894bb514c16032227'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:21.541298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1159/2331] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:21 2022] DELETE /identity/v3/users/36cfdf71cf0b461894bb514c16032227 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:21.762798 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:21.777531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c895ab-b560-4743-b3ec-e7ef69e6ada3 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:21.909808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:21.910935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:21.911369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:21.911907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] PATH_INFO: `/v3/projects/ce1f07a9f26540a682edbd2ef7759cab` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:21.913645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1f07a9f26540a682edbd2ef7759cab)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:21.915784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:22.018248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1f07a9f26540a682edbd2ef7759cab', 'request_id': 'req-b7420935-4b37-441c-beeb-a61556b6f348'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:22.027642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1f07a9f26540a682edbd2ef7759cab', 'request_id': 'req-b7420935-4b37-441c-beeb-a61556b6f348'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:22.042085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1f07a9f26540a682edbd2ef7759cab', 'request_id': 'req-b7420935-4b37-441c-beeb-a61556b6f348'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:22.072865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:22.082909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] The token cache is being invalidate because project ce1f07a9f26540a682edbd2ef7759cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:22.084065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:22.085606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b7420935-4b37-441c-beeb-a61556b6f348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:22.102325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1173/2332] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:21 2022] DELETE /identity/v3/projects/ce1f07a9f26540a682edbd2ef7759cab => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:22.110049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791156-8301-423a-9775-e3b25371f0a6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.111012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791156-8301-423a-9775-e3b25371f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.111799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791156-8301-423a-9775-e3b25371f0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.135529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e7791156-8301-423a-9775-e3b25371f0a6 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:22.137222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e7791156-8301-423a-9775-e3b25371f0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:22.221297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:22.244745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1160/2333] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:22.247199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb296c-2cd2-47f0-8d7f-828556471af3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.247492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb296c-2cd2-47f0-8d7f-828556471af3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.247759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb296c-2cd2-47f0-8d7f-828556471af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.278884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0adb296c-2cd2-47f0-8d7f-828556471af3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:22.280128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0adb296c-2cd2-47f0-8d7f-828556471af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:22.295876 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1174/2334] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:22.300479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791156-8301-423a-9775-e3b25371f0a6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:22.310599 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791156-8301-423a-9775-e3b25371f0a6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:22.315977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:22.316586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.317012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.317297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.317984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:42:22.318295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:22.320040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:22.337836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1161/2335] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:42:22.339014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb296c-2cd2-47f0-8d7f-828556471af3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:22.351644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb296c-2cd2-47f0-8d7f-828556471af3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:22.357750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:22.358371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.358652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.358920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.359569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:22.361891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:22.420450 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1175/2336] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:22 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:22.424472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:22.434769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34226231-f8e0-4cf3-aa86-ec29168e62c5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:22.545108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:22.547408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.547915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.548391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.549494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:22.551725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:22.580008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1162/2337] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:22 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:42:22.585124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:22.598738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eac2ab-cfc9-4a66-98ba-f937e760e2f9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:22.606188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:22.607423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.607897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.608132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.608803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:22.611059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:22.627722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1176/2338] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:22.628818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:22.641650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac5a4-7d54-4d17-b3bf-a2489df901ea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:22.646828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9d13f-6602-4556-90e1-74d02189e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:22.648025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d13f-6602-4556-90e1-74d02189e84d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.648025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d13f-6602-4556-90e1-74d02189e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.648641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d13f-6602-4556-90e1-74d02189e84d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.649656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9d13f-6602-4556-90e1-74d02189e84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:22.651465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9d13f-6602-4556-90e1-74d02189e84d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:22.665989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1163/2339] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:42:22.667856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:22.679928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed04952-85e9-417e-ac17-abf40f23d73b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:22.685145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:22.685975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.686256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.686532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] PATH_INFO: `/v3/projects/59111223ffed4ea59d3c4c13429c63fb/users/3e638f656fda46db92c30c788b8ed9f1/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.705263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59111223ffed4ea59d3c4c13429c63fb, user_id=3e638f656fda46db92c30c788b8ed9f1, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:22.708007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:22.728677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1177/2340] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:22 2022] PUT /identity/v3/projects/59111223ffed4ea59d3c4c13429c63fb/users/3e638f656fda46db92c30c788b8ed9f1/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:22.742035 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc55a-f10b-4f0d-90e8-b08823c3331a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:22.742688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc55a-f10b-4f0d-90e8-b08823c3331a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:22.743133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc55a-f10b-4f0d-90e8-b08823c3331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:22.778228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b15bc55a-f10b-4f0d-90e8-b08823c3331a None None] MFA Rules not processed for user `3e638f656fda46db92c30c788b8ed9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:22.780978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b15bc55a-f10b-4f0d-90e8-b08823c3331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:22.879781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1164/2341] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:22.891469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:22.893308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:22.996919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714cfa-761d-4ad2-a8cf-0f0d894f89b3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:23.003714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc84a3-d7e2-4a24-b246-01f1af0f8354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:23.004334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc84a3-d7e2-4a24-b246-01f1af0f8354 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:23.004613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc84a3-d7e2-4a24-b246-01f1af0f8354 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:23.004881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc84a3-d7e2-4a24-b246-01f1af0f8354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:23.018618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc84a3-d7e2-4a24-b246-01f1af0f8354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:23.020252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc84a3-d7e2-4a24-b246-01f1af0f8354 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:23.031790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1178/2342] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:42:23.295167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bc55a-f10b-4f0d-90e8-b08823c3331a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:23.351279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:23.370037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bc55a-f10b-4f0d-90e8-b08823c3331a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:23.375359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:23.376307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:23.376698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:23.376890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] PATH_INFO: `/v3/users/3e638f656fda46db92c30c788b8ed9f1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:23.378197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e638f656fda46db92c30c788b8ed9f1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:23.380518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:23.450983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e638f656fda46db92c30c788b8ed9f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:23.452126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e638f656fda46db92c30c788b8ed9f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:23.460473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e638f656fda46db92c30c788b8ed9f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:23.476372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e638f656fda46db92c30c788b8ed9f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:23.477989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e638f656fda46db92c30c788b8ed9f1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:23.523127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:23.523613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:23.523877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:23.526718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1165/2343] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:23 2022] DELETE /identity/v3/users/3e638f656fda46db92c30c788b8ed9f1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:23.552752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:23.554545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:23.651585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1179/2344] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:23.663732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:23.666402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:23.737378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b849c0-9173-473c-955c-ac9bd34c4792 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:23.741355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb1b8-ce15-48d8-b886-56b9e2c423e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:23.742000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb1b8-ce15-48d8-b886-56b9e2c423e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:23.742271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb1b8-ce15-48d8-b886-56b9e2c423e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:23.742555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb1b8-ce15-48d8-b886-56b9e2c423e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:23.754628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb1b8-ce15-48d8-b886-56b9e2c423e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:23.756163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb1b8-ce15-48d8-b886-56b9e2c423e6 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:23.767690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1166/2345] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:24.109015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:24.110556 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:24.129397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d3b43-8dbc-4598-b25b-ba9a6873da60 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:24.160163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:24.165206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.166241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.167258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] PATH_INFO: `/v3/projects/59111223ffed4ea59d3c4c13429c63fb` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.173930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59111223ffed4ea59d3c4c13429c63fb)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:24.176184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:24.202425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:24.241409 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59111223ffed4ea59d3c4c13429c63fb', 'request_id': 'req-16d25f69-6622-4bd6-942a-1a7ca1363c9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:24.250257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59111223ffed4ea59d3c4c13429c63fb', 'request_id': 'req-16d25f69-6622-4bd6-942a-1a7ca1363c9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:24.256778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59111223ffed4ea59d3c4c13429c63fb', 'request_id': 'req-16d25f69-6622-4bd6-942a-1a7ca1363c9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:24.273714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] The token cache is being invalidate because project 59111223ffed4ea59d3c4c13429c63fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:24.274036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:24.274764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-16d25f69-6622-4bd6-942a-1a7ca1363c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:24.276531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1180/2346] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:24 2022] DELETE /identity/v3/projects/59111223ffed4ea59d3c4c13429c63fb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:24.281425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aba85-d9f6-412b-9822-b5000ee0b71c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.281807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aba85-d9f6-412b-9822-b5000ee0b71c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.282208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aba85-d9f6-412b-9822-b5000ee0b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.304818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f31aba85-d9f6-412b-9822-b5000ee0b71c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:24.306254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f31aba85-d9f6-412b-9822-b5000ee0b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:24.417942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1167/2347] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:42:24.426235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a94d-9b7a-472f-b5b0-b57e947b09f9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.427507 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a94d-9b7a-472f-b5b0-b57e947b09f9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.428039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a94d-9b7a-472f-b5b0-b57e947b09f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.456865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cd73a94d-9b7a-472f-b5b0-b57e947b09f9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:24.458427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cd73a94d-9b7a-472f-b5b0-b57e947b09f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:24.467018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1181/2348] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:24.471202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aba85-d9f6-412b-9822-b5000ee0b71c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:24.481615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aba85-d9f6-412b-9822-b5000ee0b71c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:24.487423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:24.488040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.488319 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.488639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.489299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:42:24.489630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:24.491246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:24.499965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:24.514012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73a94d-9b7a-472f-b5b0-b57e947b09f9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:24.521172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1168/2349] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:42:24.526176 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73a94d-9b7a-472f-b5b0-b57e947b09f9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:24.535285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:24.536481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.536915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.537368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.538114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:24.540041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:24.595573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1182/2350] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:24 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:24.599557 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:24.613310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6afdb-a45d-4c23-a3ea-8788aab0aa09 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:24.692980 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:24.693631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.693944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.694272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.694923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:24.696870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:24.724023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1169/2351] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:24 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:24.727901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:24.739850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00636cf6-886d-49e6-ab92-953c92d50134 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:24.745957 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:24.747568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.748239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.748658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.749359 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:24.751393 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:24.766012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1183/2352] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:24.772641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:24.797600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb15d-e426-46aa-a34e-41d8eaeb7a97 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:24.808003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc67a71-8d4f-412f-8344-699eb35cae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:24.808953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67a71-8d4f-412f-8344-699eb35cae50 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.808953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67a71-8d4f-412f-8344-699eb35cae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.809233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67a71-8d4f-412f-8344-699eb35cae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.809885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc67a71-8d4f-412f-8344-699eb35cae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:24.811972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc67a71-8d4f-412f-8344-699eb35cae50 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:24.830905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:24.843738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1170/2353] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:24.855398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27c7c8-656e-4bc0-8e53-5768ae736ef2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:24.862514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:24.862514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.862888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.863168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] PATH_INFO: `/v3/projects/e47cc71568df474a985e5cd476747bb9/users/3338477fba7e44dbb0088d661b7d4a68/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.888296 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47cc71568df474a985e5cd476747bb9, user_id=3338477fba7e44dbb0088d661b7d4a68, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:24.891305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:24.910273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1184/2354] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:24 2022] PUT /identity/v3/projects/e47cc71568df474a985e5cd476747bb9/users/3338477fba7e44dbb0088d661b7d4a68/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:24.920958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0f81-bcf9-4fc9-bb15-2cc281eb8de7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:24.921179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0f81-bcf9-4fc9-bb15-2cc281eb8de7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:24.921593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0f81-bcf9-4fc9-bb15-2cc281eb8de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:24.969164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-123f0f81-bcf9-4fc9-bb15-2cc281eb8de7 None None] MFA Rules not processed for user `3338477fba7e44dbb0088d661b7d4a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:24.971232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-123f0f81-bcf9-4fc9-bb15-2cc281eb8de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:25.044331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1171/2355] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:25.049202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.126317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3562f-7e3f-48e7-b078-c70495ccb358 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.131682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.132311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.132588 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.132856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.133511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.135469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:25.193312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1185/2356] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:25 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:25.205138 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0f81-bcf9-4fc9-bb15-2cc281eb8de7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.236696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0f81-bcf9-4fc9-bb15-2cc281eb8de7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.313294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.314086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.314369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.314639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.315281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.317254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:25.330215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:25.347760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1172/2357] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:25 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:25.348945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.363205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a76b76-0ba5-47ed-8b38-f1f612f47bf0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.368221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.369009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.369378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.369786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.372768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.372768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:25.386781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1186/2358] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:25.390888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.404802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc72f-533e-4d1b-ae67-fbde60e99c5d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.410966 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809852e7-7a63-4889-a83c-a580d9435b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.411873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809852e7-7a63-4889-a83c-a580d9435b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.412294 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809852e7-7a63-4889-a83c-a580d9435b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.412723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809852e7-7a63-4889-a83c-a580d9435b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.413473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809852e7-7a63-4889-a83c-a580d9435b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.416120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809852e7-7a63-4889-a83c-a580d9435b87 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:25.430228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1173/2359] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:25.434445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.446065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ee990-66b4-4a19-96d5-a170446f63b0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.451773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.452406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.452887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.452999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] PATH_INFO: `/v3/projects/552fc2dc081543e4bc8032829b907e35/users/f883ccd40118450790a6e30998e14374/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.466930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:25.472268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552fc2dc081543e4bc8032829b907e35, user_id=f883ccd40118450790a6e30998e14374, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.475152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:25.494151 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1187/2360] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:25 2022] PUT /identity/v3/projects/552fc2dc081543e4bc8032829b907e35/users/f883ccd40118450790a6e30998e14374/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:25.506122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8403b-a15e-422b-98bd-eb9b8c317ce3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.509617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8403b-a15e-422b-98bd-eb9b8c317ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.510372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8403b-a15e-422b-98bd-eb9b8c317ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.549651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f4e8403b-a15e-422b-98bd-eb9b8c317ce3 None None] MFA Rules not processed for user `f883ccd40118450790a6e30998e14374`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:25.551312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f4e8403b-a15e-422b-98bd-eb9b8c317ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:25.658206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1174/2361] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:25.659835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.764642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447072b5-e56b-4da5-b388-f5adbf8b3a23 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.772967 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.773610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.773889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.774171 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.774887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.778075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:25.812499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1188/2362] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:25 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:42:25.816785 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8403b-a15e-422b-98bd-eb9b8c317ce3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.829430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8403b-a15e-422b-98bd-eb9b8c317ce3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.920955 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.921600 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.921882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.922159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.923217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.926070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:25.955995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1175/2363] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:25 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:25.960237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:25.973105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4ff2d-53f6-47c4-a624-6d3d84ebff36 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:25.978581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:25.979201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:25.979472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:25.979741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:25.980379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:25.982351 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:26.001117 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1189/2364] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:42:26.002349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:26.014598 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38076-bb33-45c7-a7a9-ba188b885d7c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:26.019933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:26.021248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:26.021532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:26.021922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] PATH_INFO: `/v3/projects/70cbc981be0e44868ac896d4237b49c6/users/1e14859df55b48a48322a5aa786c40fe/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:26.043715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cbc981be0e44868ac896d4237b49c6, user_id=1e14859df55b48a48322a5aa786c40fe, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:26.046811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:26.064359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1176/2365] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:26 2022] PUT /identity/v3/projects/70cbc981be0e44868ac896d4237b49c6/users/1e14859df55b48a48322a5aa786c40fe/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:26.068297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:26.083275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e8027-bf53-43a2-8908-59967abf5b5a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:26.154325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b1b6-a297-4b73-8845-a38bce8371d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:26.154937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b1b6-a297-4b73-8845-a38bce8371d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:26.155210 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b1b6-a297-4b73-8845-a38bce8371d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:26.155486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b1b6-a297-4b73-8845-a38bce8371d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:26.158389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b1b6-a297-4b73-8845-a38bce8371d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:26.158389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b1b6-a297-4b73-8845-a38bce8371d6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:26.170427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1190/2366] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:26.174458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:26.185461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624ce86-3198-4bd6-bc7c-db2e746a0e85 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:26.190282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:26.191014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:26.191358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:26.191687 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] PATH_INFO: `/v3/projects/70cbc981be0e44868ac896d4237b49c6/users/1e14859df55b48a48322a5aa786c40fe/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:26.193684 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cbc981be0e44868ac896d4237b49c6, user_id=1e14859df55b48a48322a5aa786c40fe, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:26.196422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:26.218547 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1177/2367] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:26 2022] PUT /identity/v3/projects/70cbc981be0e44868ac896d4237b49c6/users/1e14859df55b48a48322a5aa786c40fe/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:26.219987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:26.220573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:26.221196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:26.258281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] MFA Rules not processed for user `1e14859df55b48a48322a5aa786c40fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:26.259666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:26.320024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:26.352973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1191/2368] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:42:26.365612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:26.367518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:26.401310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:26.439681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d1cc-687c-4538-8967-4b241ced6718 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:26.444513 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:26.445153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:26.445429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:26.445724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:26.459755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:26.461200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:26.472273 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1178/2369] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:27.103039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:27.104472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:27.117775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736caa-1bf8-49b6-85bc-2cf309267636 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:27.121361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:27.122021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:27.122306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:27.122581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:27.186411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:27.187929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:27.197986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1192/2370] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:28.674095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:28.675924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:28.795236 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d0f38-c228-447d-a931-bf38a971b326 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:28.802152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:28.802873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:28.803217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:28.803577 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:28.805597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:28.875635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:28.877521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:28.886967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1179/2371] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:29.573566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:29.575065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:29.641089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142af9a-3eba-4398-b046-b54761aa92ee service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:29.645607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:29.646249 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:29.646521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:29.646790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:29.648858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:29.660263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:29.661736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:29.670321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1193/2372] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:31.390928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:31.401354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385bb0-745f-4118-afdc-930a2d2f79ce service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:31.405379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:31.406115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:31.406395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:31.406665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:31.465037 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:31.466613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:31.476126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1180/2373] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:33.775537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:33.836651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:33.842338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:33.845753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3c37-f4df-4847-96b5-fa47e931815e service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:33.846674 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed58f4-791d-4299-a9bc-050308e9671c service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:33.850309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:33.850585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c9dac-d709-44b0-bc25-8ae1a09c9bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:33.850935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:33.851187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9dac-d709-44b0-bc25-8ae1a09c9bae service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:33.851305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:33.851460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] PATH_INFO: `/v3/users/3338477fba7e44dbb0088d661b7d4a68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:33.851559 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9dac-d709-44b0-bc25-8ae1a09c9bae service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:33.851730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9dac-d709-44b0-bc25-8ae1a09c9bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:33.852573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3338477fba7e44dbb0088d661b7d4a68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:33.853442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ca1c9dac-d709-44b0-bc25-8ae1a09c9bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:33.854580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:33.863391 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c9dac-d709-44b0-bc25-8ae1a09c9bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:33.864854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c9dac-d709-44b0-bc25-8ae1a09c9bae service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:33.873039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1181/2374] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:42:33.892600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:33.910698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3338477fba7e44dbb0088d661b7d4a68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:33.923078 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3338477fba7e44dbb0088d661b7d4a68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:33.930054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3338477fba7e44dbb0088d661b7d4a68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:33.930851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3338477fba7e44dbb0088d661b7d4a68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:33.932108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3338477fba7e44dbb0088d661b7d4a68'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:33.947090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1194/2375] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:33 2022] DELETE /identity/v3/users/3338477fba7e44dbb0088d661b7d4a68 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:33.951644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:33.952003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:33.952347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:33.977894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:33.979244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:34.059414 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1182/2376] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:34.069888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:34.071366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:34.131628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175034-8acd-4218-9273-cb0d9a39145a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:34.135733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:34.136439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:34.136743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:34.137209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:34.150845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:34.152443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:34.163108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1195/2377] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:34.236144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:34.238116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:34.314224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b0adf-1d6e-41e4-9b30-99e71cc1cd25 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:34.320084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:34.320773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:34.321392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:34.321392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:34.323298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:34.338081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:34.341624 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:34.361623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1183/2378] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:34.511536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:34.513106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:34.568378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29907e-816a-4f23-9241-5cd8c3fe305a service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:34.576392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:34.577096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:34.577443 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:34.577803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] PATH_INFO: `/v3/projects/e47cc71568df474a985e5cd476747bb9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:34.579032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47cc71568df474a985e5cd476747bb9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:34.581007 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:34.638177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47cc71568df474a985e5cd476747bb9', 'request_id': 'req-abb283f7-699d-4cf1-9586-7971b7cbe7c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.645217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47cc71568df474a985e5cd476747bb9', 'request_id': 'req-abb283f7-699d-4cf1-9586-7971b7cbe7c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.650985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47cc71568df474a985e5cd476747bb9', 'request_id': 'req-abb283f7-699d-4cf1-9586-7971b7cbe7c1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.669764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] The token cache is being invalidate because project e47cc71568df474a985e5cd476747bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:34.670269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.670946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.673379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1196/2379] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:34 2022] DELETE /identity/v3/projects/e47cc71568df474a985e5cd476747bb9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:34.680442 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:34.700266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c360ea0-8b11-4819-8d58-21b5c33c8520 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:34.779953 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:34.780805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:34.781300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:34.781702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] PATH_INFO: `/v3/users/f883ccd40118450790a6e30998e14374` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:34.782995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f883ccd40118450790a6e30998e14374)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:34.785176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:34.809925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:34.839502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f883ccd40118450790a6e30998e14374'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.841007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f883ccd40118450790a6e30998e14374'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.855947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f883ccd40118450790a6e30998e14374'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.868228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f883ccd40118450790a6e30998e14374'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.869753 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f883ccd40118450790a6e30998e14374'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:34.892768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1184/2380] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:34 2022] DELETE /identity/v3/users/f883ccd40118450790a6e30998e14374 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:35.195445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:35.197208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:35.218616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb283f7-699d-4cf1-9586-7971b7cbe7c1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:35.260127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:35.291070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:35.291710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:35.291984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:35.292250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] PATH_INFO: `/v3/projects/552fc2dc081543e4bc8032829b907e35` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:35.293368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552fc2dc081543e4bc8032829b907e35)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:35.295331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:35.344472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552fc2dc081543e4bc8032829b907e35', 'request_id': 'req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.351121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552fc2dc081543e4bc8032829b907e35', 'request_id': 'req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.357019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552fc2dc081543e4bc8032829b907e35', 'request_id': 'req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.370713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] The token cache is being invalidate because project 552fc2dc081543e4bc8032829b907e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:35.370994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.371603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.373139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1197/2381] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:35 2022] DELETE /identity/v3/projects/552fc2dc081543e4bc8032829b907e35 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:35.377419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:35.378878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:35.391866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693f4f1-d45f-45bc-a6df-30808e56d0e4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:35.458592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:35.459233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:35.459509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:35.459782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] PATH_INFO: `/v3/users/1e14859df55b48a48322a5aa786c40fe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:35.460970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e14859df55b48a48322a5aa786c40fe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:35.462943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:35.516348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e14859df55b48a48322a5aa786c40fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.516991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e14859df55b48a48322a5aa786c40fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.524354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e14859df55b48a48322a5aa786c40fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.533172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e14859df55b48a48322a5aa786c40fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.533948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e14859df55b48a48322a5aa786c40fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:35.562088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1185/2382] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:35 2022] DELETE /identity/v3/users/1e14859df55b48a48322a5aa786c40fe => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:35.929376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:35.930955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:35.947124 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378ab8e-d2a8-4588-8cb7-daf70d26fa09 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.012978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.013659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.013943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.014223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] PATH_INFO: `/v3/projects/70cbc981be0e44868ac896d4237b49c6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.015365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cbc981be0e44868ac896d4237b49c6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.017305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.047543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.049755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:36.079906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cbc981be0e44868ac896d4237b49c6', 'request_id': 'req-64189107-3154-45c1-8f7f-dae5f93c924b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:36.086411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cbc981be0e44868ac896d4237b49c6', 'request_id': 'req-64189107-3154-45c1-8f7f-dae5f93c924b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:36.092503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cbc981be0e44868ac896d4237b49c6', 'request_id': 'req-64189107-3154-45c1-8f7f-dae5f93c924b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:36.097458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:36.098487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:36.116434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] The token cache is being invalidate because project 70cbc981be0e44868ac896d4237b49c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:36.117637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:36.118802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-64189107-3154-45c1-8f7f-dae5f93c924b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:36.120605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1198/2383] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:35 2022] DELETE /identity/v3/projects/70cbc981be0e44868ac896d4237b49c6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:36.127279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50237-227e-43ce-9a8f-6423a2776ba9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.127631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50237-227e-43ce-9a8f-6423a2776ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.127978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a50237-227e-43ce-9a8f-6423a2776ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.149456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c2a50237-227e-43ce-9a8f-6423a2776ba9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:36.151297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c2a50237-227e-43ce-9a8f-6423a2776ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:36.178075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435b1da-ef7b-49a7-be24-570d93aebe92 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.217736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1199/2384] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:36.227975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305476-deb0-4a00-9019-ec112f299811 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.228272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305476-deb0-4a00-9019-ec112f299811 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.228532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305476-deb0-4a00-9019-ec112f299811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.257133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-96305476-deb0-4a00-9019-ec112f299811 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:36.258477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-96305476-deb0-4a00-9019-ec112f299811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:36.267842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1200/2385] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:42:36.271820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305476-deb0-4a00-9019-ec112f299811 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.274397 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac88327-b7f1-4979-b07b-d822ec61861e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.275059 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88327-b7f1-4979-b07b-d822ec61861e service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.275341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88327-b7f1-4979-b07b-d822ec61861e service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.275611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88327-b7f1-4979-b07b-d822ec61861e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.277963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ac88327-b7f1-4979-b07b-d822ec61861e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:36.282534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96305476-deb0-4a00-9019-ec112f299811 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.287318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.288032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.288309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.288573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.289216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:42:36.289512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.291146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.304626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1201/2386] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:42:36.309012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.319458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9819768-5c3c-4c6e-96f2-c7dc6fc2e6e6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.324852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.325522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.325900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.326244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.326952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.329294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.343408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac88327-b7f1-4979-b07b-d822ec61861e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.345629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac88327-b7f1-4979-b07b-d822ec61861e service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.357260 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1186/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:42:36.359052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.359484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.360065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.362028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1202/2388] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:36 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:36.366747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.391970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:36.393457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:36.501810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:36.509979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f245-4da1-47cf-ad5f-a1e123a30e67 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.525530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.526192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.526474 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.526749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.527415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.529172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1187/2389] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:42:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:36.532212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.546788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.548317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:36.577081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1203/2390] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:36 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:36.583721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.601269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322df9-c6af-40c4-8738-d5f75b875762 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.608845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.609690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.610110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.610445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.611751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.613623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.625204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1204/2391] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:36.630548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.643734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69507bde-e5b5-4a66-97aa-a7022fcf8e29 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.649111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.650336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.650336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.650701 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.651439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.653704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.678879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987a7ec-6acb-4b0f-8033-b9f7ffa07ac5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.682077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1205/2392] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:36.688293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:36.689636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c168-9bb9-4672-a4ac-5decb3b2863b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.690400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c168-9bb9-4672-a4ac-5decb3b2863b service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.690733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c168-9bb9-4672-a4ac-5decb3b2863b service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.691069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c168-9bb9-4672-a4ac-5decb3b2863b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.700045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92277119-4e2d-4a16-826a-36e265dcbcdc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:36.701847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c168-9bb9-4672-a4ac-5decb3b2863b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.703787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c168-9bb9-4672-a4ac-5decb3b2863b service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.705237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:36.706041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.706327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.706628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] PATH_INFO: `/v3/projects/35cfa5e4316340afb522f173cc2c7d54/users/4f5986e86e5b4ade9ff7e82b2856316d/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.714427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1188/2393] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:42:36.726278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cfa5e4316340afb522f173cc2c7d54, user_id=4f5986e86e5b4ade9ff7e82b2856316d, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:36.729285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:36.732883 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:36.747396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1206/2394] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:36 2022] PUT /identity/v3/projects/35cfa5e4316340afb522f173cc2c7d54/users/4f5986e86e5b4ade9ff7e82b2856316d/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:36.759473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6dd84-f0e3-4f85-8714-d1ed2507a45b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:36.759757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6dd84-f0e3-4f85-8714-d1ed2507a45b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:36.760454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6dd84-f0e3-4f85-8714-d1ed2507a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:36.805649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-99d6dd84-f0e3-4f85-8714-d1ed2507a45b None None] MFA Rules not processed for user `4f5986e86e5b4ade9ff7e82b2856316d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:36.807482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99d6dd84-f0e3-4f85-8714-d1ed2507a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:36.933280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1189/2395] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:42:36.937687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:37.051993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44373f-4391-41f6-a590-ce7c1928da7c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:37.060275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:37.061214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.061632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.061975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.063172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:37.070111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:37.108188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1207/2396] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:36 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:37.112928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6dd84-f0e3-4f85-8714-d1ed2507a45b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:37.127111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6dd84-f0e3-4f85-8714-d1ed2507a45b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:37.190835 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:37.191450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.191727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.191998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.192632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:37.194663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:37.218109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1190/2397] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:37 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:37.223002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:37.235449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c357cb-702b-40dd-8065-46583832b841 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:37.242382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:37.243028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.243320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.243634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.247475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:37.247475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:37.262655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1208/2398] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:37.263870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:37.275731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45cfa-d5af-4f89-9257-480c1631d5b7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:37.282758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:37.283493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.283774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.284048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] PATH_INFO: `/v3/projects/8c87e213957b4fbb94a9c83027814b32/users/dc5ae65894f74f6dbe4ae90cae791bff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.288246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:37.311211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c87e213957b4fbb94a9c83027814b32, user_id=dc5ae65894f74f6dbe4ae90cae791bff, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:37.314639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:37.338689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1191/2399] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:37 2022] PUT /identity/v3/projects/8c87e213957b4fbb94a9c83027814b32/users/dc5ae65894f74f6dbe4ae90cae791bff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:37.339305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:37.351038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bf787-ee12-46ef-92c7-19de8ad8e703 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:37.432240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97027159-f9a6-4716-9505-64d9927610dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:37.433072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97027159-f9a6-4716-9505-64d9927610dc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.433424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97027159-f9a6-4716-9505-64d9927610dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.433851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97027159-f9a6-4716-9505-64d9927610dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.434853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97027159-f9a6-4716-9505-64d9927610dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:37.436824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97027159-f9a6-4716-9505-64d9927610dc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:37.452854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1209/2400] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:42:37.454086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:37.464760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fd2a-88bf-4ca5-bf92-c0f9f7315a16 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:37.470462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:37.471111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.471392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.471664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] PATH_INFO: `/v3/projects/8c87e213957b4fbb94a9c83027814b32/users/dc5ae65894f74f6dbe4ae90cae791bff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.473708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c87e213957b4fbb94a9c83027814b32, user_id=dc5ae65894f74f6dbe4ae90cae791bff, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:37.476357 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:37.488556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1192/2401] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:37 2022] PUT /identity/v3/projects/8c87e213957b4fbb94a9c83027814b32/users/dc5ae65894f74f6dbe4ae90cae791bff/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:37.501721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f00e6a-0897-4e3f-8004-56388209e03a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.501936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f00e6a-0897-4e3f-8004-56388209e03a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.502215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f00e6a-0897-4e3f-8004-56388209e03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.536865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-73f00e6a-0897-4e3f-8004-56388209e03a None None] MFA Rules not processed for user `dc5ae65894f74f6dbe4ae90cae791bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:37.538354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-73f00e6a-0897-4e3f-8004-56388209e03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:37.607337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:37.628033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1210/2402] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:37.639050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:37.640796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:37.710974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9756-166f-4b85-b9da-8ecb62680495 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:37.715877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8942e-c52d-4c5d-bcb6-9527c6cb4697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:37.716582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8942e-c52d-4c5d-bcb6-9527c6cb4697 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:37.717136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8942e-c52d-4c5d-bcb6-9527c6cb4697 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:37.717416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8942e-c52d-4c5d-bcb6-9527c6cb4697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:37.728811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8942e-c52d-4c5d-bcb6-9527c6cb4697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:37.730272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8942e-c52d-4c5d-bcb6-9527c6cb4697 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:37.741107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1193/2403] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:38.511556 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f00e6a-0897-4e3f-8004-56388209e03a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:38.584531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f00e6a-0897-4e3f-8004-56388209e03a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:38.589567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:38.590310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:38.590762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:38.590980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] PATH_INFO: `/v3/users/4f5986e86e5b4ade9ff7e82b2856316d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:38.593022 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5986e86e5b4ade9ff7e82b2856316d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:38.595293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:38.656337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5986e86e5b4ade9ff7e82b2856316d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:38.670309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5986e86e5b4ade9ff7e82b2856316d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:38.677920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5986e86e5b4ade9ff7e82b2856316d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:38.678664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5986e86e5b4ade9ff7e82b2856316d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:38.679279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5986e86e5b4ade9ff7e82b2856316d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:38.734848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1211/2404] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:38 2022] DELETE /identity/v3/users/4f5986e86e5b4ade9ff7e82b2856316d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:38.739849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:38.740427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:38.740610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:38.759897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:38.761098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:38.827861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1194/2405] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:38.837960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:38.839559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:38.905949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b98e6-4917-458f-94dd-08f3105fd13f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:38.916586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:38.916586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:38.916586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:38.916586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:38.938739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:38.940568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:38.961963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1212/2406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:39.258633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:39.260085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:39.283495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f973f-fddb-43ef-8593-af4344f442c3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:39.289011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:39.289885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:39.290310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:39.290679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] PATH_INFO: `/v3/projects/35cfa5e4316340afb522f173cc2c7d54` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:39.291846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cfa5e4316340afb522f173cc2c7d54)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:39.293876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:39.344828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cfa5e4316340afb522f173cc2c7d54', 'request_id': 'req-feceb84d-d7e0-4453-ba1b-8214a496667a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.350314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cfa5e4316340afb522f173cc2c7d54', 'request_id': 'req-feceb84d-d7e0-4453-ba1b-8214a496667a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.358172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cfa5e4316340afb522f173cc2c7d54', 'request_id': 'req-feceb84d-d7e0-4453-ba1b-8214a496667a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.370162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:39.378329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] The token cache is being invalidate because project 35cfa5e4316340afb522f173cc2c7d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:39.378329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.380440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.391365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1195/2407] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:39 2022] DELETE /identity/v3/projects/35cfa5e4316340afb522f173cc2c7d54 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:39.395413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:39.405700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c3d0e-3cb6-49f2-946b-ff3d89b96311 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:39.415877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:39.467375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:39.468121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:39.468447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:39.468652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] PATH_INFO: `/v3/users/dc5ae65894f74f6dbe4ae90cae791bff` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:39.469880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5ae65894f74f6dbe4ae90cae791bff)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:39.472043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:39.547248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5ae65894f74f6dbe4ae90cae791bff'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.560320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5ae65894f74f6dbe4ae90cae791bff'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.568651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5ae65894f74f6dbe4ae90cae791bff'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.569955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5ae65894f74f6dbe4ae90cae791bff'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.571145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5c3cb57-1596-4aab-97c9-6b326728fcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5ae65894f74f6dbe4ae90cae791bff'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:39.607511 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1213/2408] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:39 2022] DELETE /identity/v3/users/dc5ae65894f74f6dbe4ae90cae791bff => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:39.966353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:39.967858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:39.981388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feceb84d-d7e0-4453-ba1b-8214a496667a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:40.052661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:40.053431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.053762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.054060 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] PATH_INFO: `/v3/projects/8c87e213957b4fbb94a9c83027814b32` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.055183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c87e213957b4fbb94a9c83027814b32)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:40.057155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:40.127183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c87e213957b4fbb94a9c83027814b32', 'request_id': 'req-92bde660-250c-45b8-b113-14f8c0746d35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:40.134967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c87e213957b4fbb94a9c83027814b32', 'request_id': 'req-92bde660-250c-45b8-b113-14f8c0746d35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:40.150112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c87e213957b4fbb94a9c83027814b32', 'request_id': 'req-92bde660-250c-45b8-b113-14f8c0746d35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:40.170968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] The token cache is being invalidate because project 8c87e213957b4fbb94a9c83027814b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:40.171282 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:40.172490 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92bde660-250c-45b8-b113-14f8c0746d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:40.174846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1196/2409] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:39 2022] DELETE /identity/v3/projects/8c87e213957b4fbb94a9c83027814b32 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:40.179704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3bbd7-d6c9-46ea-a7e4-5ce4a66a6292 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.180223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3bbd7-d6c9-46ea-a7e4-5ce4a66a6292 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.180662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3bbd7-d6c9-46ea-a7e4-5ce4a66a6292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.202119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d3a3bbd7-d6c9-46ea-a7e4-5ce4a66a6292 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:40.203835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3a3bbd7-d6c9-46ea-a7e4-5ce4a66a6292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:40.297047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1214/2410] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:42:40.306000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3ede-82f6-4a15-8430-a31a169dd0c1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.306208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3ede-82f6-4a15-8430-a31a169dd0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.306676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3ede-82f6-4a15-8430-a31a169dd0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.331094 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-716e3ede-82f6-4a15-8430-a31a169dd0c1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:40.332461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-716e3ede-82f6-4a15-8430-a31a169dd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:40.340774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1197/2411] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:40.345211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3bbd7-d6c9-46ea-a7e4-5ce4a66a6292 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:40.363891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3bbd7-d6c9-46ea-a7e4-5ce4a66a6292 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:40.363891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:40.363891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.363891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.364445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.364445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:42:40.364445 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:40.365680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:40.396563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1215/2412] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:42:40.398359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e3ede-82f6-4a15-8430-a31a169dd0c1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:40.414969 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e3ede-82f6-4a15-8430-a31a169dd0c1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:40.420770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:40.421730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.422196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.423621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.424522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:40.426696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:40.473239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1198/2413] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:40 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:40.474493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:40.488452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235f01-5608-404a-a1f6-47930fbdf95b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:40.534067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:40.585849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:40.586669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.587028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.587304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.587940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:40.589907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:40.616619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1216/2414] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:40 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:42:40.620616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:40.633484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2778d6-513c-400a-9eb4-a6cb730610fa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:40.639366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:40.640334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.640872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.641369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.642125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:40.643814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:40.659377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1199/2415] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:40.663191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:40.674308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75266f67-7b4e-450a-8449-705ccc17139f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:40.679731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8acd3-74b6-4703-ab41-3fe9ebaf0c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:40.680617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8acd3-74b6-4703-ab41-3fe9ebaf0c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.681061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8acd3-74b6-4703-ab41-3fe9ebaf0c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.681345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8acd3-74b6-4703-ab41-3fe9ebaf0c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.682075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8acd3-74b6-4703-ab41-3fe9ebaf0c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:40.683907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8acd3-74b6-4703-ab41-3fe9ebaf0c8a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:40.696514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1217/2416] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:40.700633 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:40.713673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520c1a-c5b5-48d8-880b-5092bd711c5f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:40.730972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:40.737086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.737449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.737905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] PATH_INFO: `/v3/projects/e1b2edbe2b344556bef17f77c7a0ab53/users/e96facf6c4bf4a2a9bd0c49568c4cffa/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.771991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b2edbe2b344556bef17f77c7a0ab53, user_id=e96facf6c4bf4a2a9bd0c49568c4cffa, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:40.780413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:40.814477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1200/2417] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:40 2022] PUT /identity/v3/projects/e1b2edbe2b344556bef17f77c7a0ab53/users/e96facf6c4bf4a2a9bd0c49568c4cffa/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:40.825202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ea8a-0aa1-4cb4-b869-966b1fdf7fa0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:40.825495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ea8a-0aa1-4cb4-b869-966b1fdf7fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:40.825801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ea8a-0aa1-4cb4-b869-966b1fdf7fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:40.863426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-da98ea8a-0aa1-4cb4-b869-966b1fdf7fa0 None None] MFA Rules not processed for user `e96facf6c4bf4a2a9bd0c49568c4cffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:40.864709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-da98ea8a-0aa1-4cb4-b869-966b1fdf7fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:40.947963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1218/2418] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:40.952727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:40.983996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:41.020483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4ca3-9a08-485d-a473-ca259eaedd1f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:41.025250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:41.025895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.026242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.026435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.027068 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:41.028981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:41.064922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1201/2419] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:40 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:41.066469 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98ea8a-0aa1-4cb4-b869-966b1fdf7fa0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:41.077854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98ea8a-0aa1-4cb4-b869-966b1fdf7fa0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:41.134002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:41.134616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.134902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.135171 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.135995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:41.137975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:41.167780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1219/2420] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:41 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:41.172307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:41.185044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8a356-9cbb-4eab-be8f-a9423100eff7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:41.190507 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:41.191145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.191418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.191713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.192356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:41.194022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:41.205535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1202/2421] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:41.209846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:41.220051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c61f0-eed9-4999-b864-15d13edb3d2c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:41.224688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:41.225341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.225653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.225930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] PATH_INFO: `/v3/projects/3d9dd837585047d2a3f65a32ef481065/users/ad46e46618774d6097cae09511a817a1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.242396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9dd837585047d2a3f65a32ef481065, user_id=ad46e46618774d6097cae09511a817a1, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:41.248035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:41.253426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:41.263175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1220/2422] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:41 2022] PUT /identity/v3/projects/3d9dd837585047d2a3f65a32ef481065/users/ad46e46618774d6097cae09511a817a1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:41.267088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:41.288503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0db328-cae5-491c-9e1e-b5237aeab162 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:41.372894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd2471-9f2d-4aaf-889e-e6a0fe1b9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:41.373433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd2471-9f2d-4aaf-889e-e6a0fe1b9351 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.373745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd2471-9f2d-4aaf-889e-e6a0fe1b9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.374019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd2471-9f2d-4aaf-889e-e6a0fe1b9351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.374682 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd2471-9f2d-4aaf-889e-e6a0fe1b9351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:41.376338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd2471-9f2d-4aaf-889e-e6a0fe1b9351 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:41.387788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1203/2423] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:41.392183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:41.409560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97c169-c7c0-4405-8f96-dfd1c07e25ea admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:41.414137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:41.414829 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.415171 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.415627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] PATH_INFO: `/v3/projects/3d9dd837585047d2a3f65a32ef481065/users/ad46e46618774d6097cae09511a817a1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.417797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d9dd837585047d2a3f65a32ef481065, user_id=ad46e46618774d6097cae09511a817a1, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:41.420570 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:41.434380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1221/2424] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:41 2022] PUT /identity/v3/projects/3d9dd837585047d2a3f65a32ef481065/users/ad46e46618774d6097cae09511a817a1/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:41.445823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cba89-6d48-49ae-ab6a-dffdd65918a7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.446103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cba89-6d48-49ae-ab6a-dffdd65918a7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.446377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cba89-6d48-49ae-ab6a-dffdd65918a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.478134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-247cba89-6d48-49ae-ab6a-dffdd65918a7 None None] MFA Rules not processed for user `ad46e46618774d6097cae09511a817a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:41.479538 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-247cba89-6d48-49ae-ab6a-dffdd65918a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:41.559514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1204/2425] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:41.570574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:41.572268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:41.635328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862df185-2e08-42a3-b6d8-b11e4d9c56d8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:41.639212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310d563-b4f4-4bcd-85ee-8097046009b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:41.639913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d563-b4f4-4bcd-85ee-8097046009b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:41.640263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d563-b4f4-4bcd-85ee-8097046009b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:41.640603 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310d563-b4f4-4bcd-85ee-8097046009b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:41.651794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310d563-b4f4-4bcd-85ee-8097046009b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:41.653328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310d563-b4f4-4bcd-85ee-8097046009b7 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:41.674771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1222/2426] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:42.171786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cba89-6d48-49ae-ab6a-dffdd65918a7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:42.200237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:42.246534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cba89-6d48-49ae-ab6a-dffdd65918a7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:42.251495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:42.252225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:42.252571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:42.252910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] PATH_INFO: `/v3/users/e96facf6c4bf4a2a9bd0c49568c4cffa` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:42.254143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96facf6c4bf4a2a9bd0c49568c4cffa)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:42.256152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:42.310263 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96facf6c4bf4a2a9bd0c49568c4cffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:42.310910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96facf6c4bf4a2a9bd0c49568c4cffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:42.317972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96facf6c4bf4a2a9bd0c49568c4cffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:42.327002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96facf6c4bf4a2a9bd0c49568c4cffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:42.327604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96facf6c4bf4a2a9bd0c49568c4cffa'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:42.348113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1205/2427] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:42 2022] DELETE /identity/v3/users/e96facf6c4bf4a2a9bd0c49568c4cffa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:42.353126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:42.353410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:42.353683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:42.381232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:42.382609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:42.461069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1223/2428] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:42.468162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:42.469937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:42.535727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ec2f-1154-4d45-979a-697a6fa01bbf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:42.539465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:42.540063 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:42.540338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:42.540602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:42.549390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:42.550950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:42.562744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1206/2429] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:42.880955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:42.883200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:42.905387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c13181-1b72-4931-9ff6-b9a6b9f0e204 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:42.911775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:42.912905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:42.913526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:42.914109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] PATH_INFO: `/v3/projects/e1b2edbe2b344556bef17f77c7a0ab53` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:42.915559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b2edbe2b344556bef17f77c7a0ab53)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:42.918905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:42.978206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b2edbe2b344556bef17f77c7a0ab53', 'request_id': 'req-4513dc99-5302-46d2-ad3f-1a05ab226cf2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:42.985854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b2edbe2b344556bef17f77c7a0ab53', 'request_id': 'req-4513dc99-5302-46d2-ad3f-1a05ab226cf2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:42.992971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b2edbe2b344556bef17f77c7a0ab53', 'request_id': 'req-4513dc99-5302-46d2-ad3f-1a05ab226cf2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.014196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] The token cache is being invalidate because project e1b2edbe2b344556bef17f77c7a0ab53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:43.014738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.015828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.017920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1224/2430] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:42 2022] DELETE /identity/v3/projects/e1b2edbe2b344556bef17f77c7a0ab53 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:43.021571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:43.044699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c334c7a-b9e0-4070-b84c-ebfa221767ac service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:43.107373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:43.138516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:43.139400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:43.139757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:43.140033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] PATH_INFO: `/v3/users/ad46e46618774d6097cae09511a817a1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:43.141534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad46e46618774d6097cae09511a817a1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:43.145290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:43.224168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad46e46618774d6097cae09511a817a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.224965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad46e46618774d6097cae09511a817a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.233868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad46e46618774d6097cae09511a817a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.256843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad46e46618774d6097cae09511a817a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.257429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-813b13cd-8370-4f7f-a3a0-57b255431548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad46e46618774d6097cae09511a817a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.293230 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1207/2431] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:42:43 2022] DELETE /identity/v3/users/ad46e46618774d6097cae09511a817a1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:42:43.628797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:43.631686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:43.658683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513dc99-5302-46d2-ad3f-1a05ab226cf2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:43.663919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:43.736696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:43.737501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:43.738082 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:43.738424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] PATH_INFO: `/v3/projects/3d9dd837585047d2a3f65a32ef481065` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:43.739715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d9dd837585047d2a3f65a32ef481065)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:43.742368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:43.796984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d9dd837585047d2a3f65a32ef481065', 'request_id': 'req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.805996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d9dd837585047d2a3f65a32ef481065', 'request_id': 'req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.812559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d9dd837585047d2a3f65a32ef481065', 'request_id': 'req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.837108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] The token cache is being invalidate because project 3d9dd837585047d2a3f65a32ef481065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:42:43.837692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.838519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d1c32c38-cbe9-4d4c-9a47-3c4c7c6a56fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:42:43.840673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1225/2432] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:42:43 2022] DELETE /identity/v3/projects/3d9dd837585047d2a3f65a32ef481065 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:43.846703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5d51-2a88-4edf-a696-189ea3fe82d8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:43.846997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5d51-2a88-4edf-a696-189ea3fe82d8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:43.847277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a5d51-2a88-4edf-a696-189ea3fe82d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:43.867853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8b2a5d51-2a88-4edf-a696-189ea3fe82d8 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:43.869143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8b2a5d51-2a88-4edf-a696-189ea3fe82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:43.936995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1208/2433] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:43.945178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29150-cd43-4dcb-8d51-bc9445639d23 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:43.945868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29150-cd43-4dcb-8d51-bc9445639d23 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:43.945868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29150-cd43-4dcb-8d51-bc9445639d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:43.975193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-58c29150-cd43-4dcb-8d51-bc9445639d23 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:43.976960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-58c29150-cd43-4dcb-8d51-bc9445639d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:43.989664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1226/2434] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:43.993769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a5d51-2a88-4edf-a696-189ea3fe82d8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:44.005145 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a5d51-2a88-4edf-a696-189ea3fe82d8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:44.011602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:44.012342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.012628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.012902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.013912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:42:44.014238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:44.016597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:44.033365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1209/2435] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:42:44.035426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29150-cd43-4dcb-8d51-bc9445639d23 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:44.045192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29150-cd43-4dcb-8d51-bc9445639d23 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:44.050365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:44.050913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.051204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.051467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.052112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:44.054141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:44.085640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1227/2436] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:42:44 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:42:44.089650 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:44.101849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6f671-91bf-4188-9891-dcc3ff31f1d5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:44.158772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:44.176564 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:44.177660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.178220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.179337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.180106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:44.182325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:44.213651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1210/2437] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:42:44 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:42:44.217426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:44.229356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381b8a6-9182-4d3c-b93d-58a78b3ffa30 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:44.234223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:44.235092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.235480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.236057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.237500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:44.239453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:44.252721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1228/2438] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:42:44.256944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:44.273727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a865f-bbd0-4db0-95dc-3a2b60de7c44 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:44.279038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298a2a-3d25-41ed-ac39-7b2072a398b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:44.280200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298a2a-3d25-41ed-ac39-7b2072a398b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.280784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298a2a-3d25-41ed-ac39-7b2072a398b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.281326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298a2a-3d25-41ed-ac39-7b2072a398b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.282352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298a2a-3d25-41ed-ac39-7b2072a398b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:44.284539 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298a2a-3d25-41ed-ac39-7b2072a398b8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:44.310542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1211/2439] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:42:44.314879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:44.325489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6353f6-4481-4183-a25d-79e788f889f1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:44.334294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:44.335225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.335505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.335778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] PATH_INFO: `/v3/projects/7ba0593f6cbc4a91a38891a8d864db65/users/da9152c6781e419bace09febc86ae80c/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.353873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba0593f6cbc4a91a38891a8d864db65, user_id=da9152c6781e419bace09febc86ae80c, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:44.356777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:44.379583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1229/2440] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:42:44 2022] PUT /identity/v3/projects/7ba0593f6cbc4a91a38891a8d864db65/users/da9152c6781e419bace09febc86ae80c/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:42:44.397447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.397447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.397447 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.424815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] MFA Rules not processed for user `da9152c6781e419bace09febc86ae80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:44.426169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:44.523606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1212/2441] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:42:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:44.537209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:44.539545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:44.603259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:44.656247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348f33a-35bf-46cd-a3aa-fdf7b66a113e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:44.671487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb2b41-e7a3-47d5-b51e-f471843499dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3160eee18a4f7cb9f6880ec1b672a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:44.672421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2b41-e7a3-47d5-b51e-f471843499dc service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:44.672858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2b41-e7a3-47d5-b51e-f471843499dc service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:44.673383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2b41-e7a3-47d5-b51e-f471843499dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:44.686322 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb2b41-e7a3-47d5-b51e-f471843499dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:44.687934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb2b41-e7a3-47d5-b51e-f471843499dc service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:44.698333 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1230/2442] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:50.633426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:50.635158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:50.735602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac383-85d1-418f-a3a9-399cdae8a998 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:50.741503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:50.742164 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:50.742934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:50.742934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:50.744495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:50.757166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:50.758795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:50.769885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1213/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:42:53.799787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:53.800284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:53.800284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:53.820553 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:42:53.822142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:53.880186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1231/2444] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 30 00:42:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:42:53.898125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:53.899843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:53.968021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:42:53.995046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbddc2-758f-4ede-a775-fd6ed3411b77 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:53.999998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:54.000660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:54.000940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:54.001213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:54.009201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:54.010846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:54.019329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1214/2445] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:42:55.448355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:42:55.449892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:55.470786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75730e5-e3d9-46eb-9a03-9195c99546e2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:42:55.478434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:42:55.479415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:42:55.479696 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:42:55.479969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:42:55.482077 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:42:55.496091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:42:55.497752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:42:55.511575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1232/2446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:42:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:03.142418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:03.143928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:03.216718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f791a1c-622e-4e3f-b571-9c79f05afcb7 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:03.220380 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:03.220975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:03.221248 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:03.221514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:03.223305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:03.292184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:03.293532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:03.303393 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1215/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:04.321830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:04.323358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:04.334897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be61fd-879b-45a4-8cac-f1a16202b681 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:04.338480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:04.339080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:04.339363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:04.339637 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:04.341311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:04.353747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:04.355204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:04.365415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1233/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:07.585620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:07.587907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:07.699257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:07.700765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:07.739184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464c3f-9370-4d2c-9c08-b6563ff33fb2 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:07.750546 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:07.751499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:07.752328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:07.752552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd4cd0-020a-4fa8-a309-b7552d939fb9 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:07.752730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] PATH_INFO: `/v3/users/a330928e555a4f1ba17ab73d8c2f2914` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:07.754779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a330928e555a4f1ba17ab73d8c2f2914)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:07.759908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:07.760817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:07.763514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:07.763907 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:07.764095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:07.771425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:07.790576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:07.792208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:07.805722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1216/2449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:07.834535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a330928e555a4f1ba17ab73d8c2f2914'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:07.851048 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a330928e555a4f1ba17ab73d8c2f2914'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:07.858222 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a330928e555a4f1ba17ab73d8c2f2914'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:07.858988 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a330928e555a4f1ba17ab73d8c2f2914'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:07.859641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7dc0dcd4-502a-43df-922a-931b8d3bb762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a330928e555a4f1ba17ab73d8c2f2914'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:07.873316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1234/2450] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:07 2022] DELETE /identity/v3/users/a330928e555a4f1ba17ab73d8c2f2914 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:08.050749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.064508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b1a4f-6b4b-4d72-8440-5915c7c56adc service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.080795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:08.162607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.163344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.163760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.164103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] PATH_INFO: `/v3/projects/bbf355bbc7b846f298928066e6b91b54` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.165353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf355bbc7b846f298928066e6b91b54)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.167984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.242091 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf355bbc7b846f298928066e6b91b54', 'request_id': 'req-f33d0770-b123-42f9-bfed-922d9c087cf3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.248082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf355bbc7b846f298928066e6b91b54', 'request_id': 'req-f33d0770-b123-42f9-bfed-922d9c087cf3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.258201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf355bbc7b846f298928066e6b91b54', 'request_id': 'req-f33d0770-b123-42f9-bfed-922d9c087cf3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.271226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] The token cache is being invalidate because project bbf355bbc7b846f298928066e6b91b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:08.271475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.272199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f33d0770-b123-42f9-bfed-922d9c087cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.274024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1217/2451] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:08 2022] DELETE /identity/v3/projects/bbf355bbc7b846f298928066e6b91b54 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:08.278980 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e2ae-5536-401c-be1a-db90b5ff3b6c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.279663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e2ae-5536-401c-be1a-db90b5ff3b6c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.280040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e2ae-5536-401c-be1a-db90b5ff3b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.300852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3068e2ae-5536-401c-be1a-db90b5ff3b6c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:08.302174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3068e2ae-5536-401c-be1a-db90b5ff3b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:08.325691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:08.374620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1235/2452] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:08.384050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbcd3-9717-4bb3-ab29-73b09127b2d2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.384322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbcd3-9717-4bb3-ab29-73b09127b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.384597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cbcd3-9717-4bb3-ab29-73b09127b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.409043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c17cbcd3-9717-4bb3-ab29-73b09127b2d2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:08.410525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c17cbcd3-9717-4bb3-ab29-73b09127b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:08.419144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1218/2453] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:08.423425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068e2ae-5536-401c-be1a-db90b5ff3b6c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.433520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068e2ae-5536-401c-be1a-db90b5ff3b6c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.440903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.441529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.441863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.442134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.442850 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:08.443081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.444693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.457849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1236/2454] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:08.462286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cbcd3-9717-4bb3-ab29-73b09127b2d2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.472161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cbcd3-9717-4bb3-ab29-73b09127b2d2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.477426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.478176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.478759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.479156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.479893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.482160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.513744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1219/2455] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:08 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:08.518942 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.530456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085bf02-1298-4267-9c65-c867271220ba admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.596004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.596623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.596902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.597173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.598028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.600367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.629300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1237/2456] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:08 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:08.633620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.645408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eacc4a-8cf3-455b-be73-fecf8979ebe0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.655589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.656259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.656544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.656815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.657575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.659125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.680949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1220/2457] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:08.681688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.694370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.696312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:08.698790 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339eb3b-e8ce-4154-95f6-6f86921dc616 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.711037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.711700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.711935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.712387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.713040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.714697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.720310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b22821-71ed-4a0d-aca5-626ef191a0b1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.726445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.727209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.727589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.728011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] PATH_INFO: `/v3/users/da9152c6781e419bace09febc86ae80c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.729253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9152c6781e419bace09febc86ae80c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.736279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.745003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1238/2458] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:08.749057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:08.764153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8c717-75a1-4e9c-97ff-6f62db84cb31 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:08.770520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150404d-2201-4e18-a0f4-c555e2a8518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:08.771229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150404d-2201-4e18-a0f4-c555e2a8518b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.772084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150404d-2201-4e18-a0f4-c555e2a8518b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.773113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150404d-2201-4e18-a0f4-c555e2a8518b admin admin] PATH_INFO: `/v3/projects/60f01e7804bb4805b0a4fbf67fbb5684/users/d9926f6e80d54383b8849e77da22b2fd/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.796590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150404d-2201-4e18-a0f4-c555e2a8518b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f01e7804bb4805b0a4fbf67fbb5684, user_id=d9926f6e80d54383b8849e77da22b2fd, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:08.799930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150404d-2201-4e18-a0f4-c555e2a8518b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:08.811923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9152c6781e419bace09febc86ae80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.814757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9152c6781e419bace09febc86ae80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.831737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9152c6781e419bace09febc86ae80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.834373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:08.839341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1239/2459] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:08 2022] PUT /identity/v3/projects/60f01e7804bb4805b0a4fbf67fbb5684/users/d9926f6e80d54383b8849e77da22b2fd/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:08.850841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9152c6781e419bace09febc86ae80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.851152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.851717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.852231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.852350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-05f113ed-8c10-4958-a093-cf6a2403c20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9152c6781e419bace09febc86ae80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:08.889364 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1221/2460] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:08 2022] DELETE /identity/v3/users/da9152c6781e419bace09febc86ae80c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:08.893928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:08.894316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:08.894734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:08.920814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] MFA Rules not processed for user `d9926f6e80d54383b8849e77da22b2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:08.923183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:08.926762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:08.928087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.007140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:09.013099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1222/2461] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:09.013099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.013099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.025446 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8f3c1-9a92-44ed-b352-25146a311a6f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.029826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1240/2462] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:09.030592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.031717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.032310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.032481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.032585 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.032821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] PATH_INFO: `/v3/users/d8876e2cba404244b731450ff5112c99` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.034001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8876e2cba404244b731450ff5112c99)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.035947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.084509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8876e2cba404244b731450ff5112c99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.085730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8876e2cba404244b731450ff5112c99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.090002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024bf54-987b-41af-9486-6d8f9d8516e7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.093187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8876e2cba404244b731450ff5112c99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.093969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.094675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.095018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.095345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.101199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8876e2cba404244b731450ff5112c99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.102066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8876e2cba404244b731450ff5112c99'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.105364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.106823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.116746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1241/2463] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:09.117536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.118853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.122735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1223/2464] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:09 2022] DELETE /identity/v3/users/d8876e2cba404244b731450ff5112c99 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:09.202236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a794b-b231-45fe-877a-e975fb284405 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.268729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.269444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.269776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.270050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.271872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.307772 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:09.332748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.334380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.344043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1242/2465] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:09.407506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.409584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.481401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:09.502640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f827-7d52-48ae-a3cb-30f7fd6aba27 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.510144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.510788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.511066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.511338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] PATH_INFO: `/v3/projects/7785ca6defde4e40bf3e68557eb2290d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.512631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7785ca6defde4e40bf3e68557eb2290d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.513422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.514859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.514984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.540769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ad8f7-0f41-4c87-8e54-011aa0e94c93 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.546024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.547586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.548313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.548672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] PATH_INFO: `/v3/projects/7ba0593f6cbc4a91a38891a8d864db65` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.551946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba0593f6cbc4a91a38891a8d864db65)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.552353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.580744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7785ca6defde4e40bf3e68557eb2290d', 'request_id': 'req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.587680 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7785ca6defde4e40bf3e68557eb2290d', 'request_id': 'req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.597128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7785ca6defde4e40bf3e68557eb2290d', 'request_id': 'req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.613481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] The token cache is being invalidate because project 7785ca6defde4e40bf3e68557eb2290d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:09.613851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.614728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b73bb30d-afbe-40f4-a8f4-bf7d3185b6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.618585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba0593f6cbc4a91a38891a8d864db65', 'request_id': 'req-1683d96f-57cd-4834-b922-1b6e31e67de0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.620046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1224/2466] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:09 2022] DELETE /identity/v3/projects/7785ca6defde4e40bf3e68557eb2290d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:09.621443 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5b16-2798-4759-9458-f21cb586d496 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.621771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5b16-2798-4759-9458-f21cb586d496 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.622080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5b16-2798-4759-9458-f21cb586d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.626728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba0593f6cbc4a91a38891a8d864db65', 'request_id': 'req-1683d96f-57cd-4834-b922-1b6e31e67de0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.634111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba0593f6cbc4a91a38891a8d864db65', 'request_id': 'req-1683d96f-57cd-4834-b922-1b6e31e67de0'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.644748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4ffe5b16-2798-4759-9458-f21cb586d496 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:09.646064 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ffe5b16-2798-4759-9458-f21cb586d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.653421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] The token cache is being invalidate because project 7ba0593f6cbc4a91a38891a8d864db65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:09.654056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.654692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1683d96f-57cd-4834-b922-1b6e31e67de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:09.656756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1243/2467] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:09 2022] DELETE /identity/v3/projects/7ba0593f6cbc4a91a38891a8d864db65 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:09.661477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e76a-e9fd-4d0c-9c21-b0bd0196105c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.661816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e76a-e9fd-4d0c-9c21-b0bd0196105c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.662126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1e76a-e9fd-4d0c-9c21-b0bd0196105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.688781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0de1e76a-e9fd-4d0c-9c21-b0bd0196105c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:09.690499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0de1e76a-e9fd-4d0c-9c21-b0bd0196105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.739673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1225/2468] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:09.747130 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e90ab-5b6c-4926-ad27-7b40c7e17120 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.747584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e90ab-5b6c-4926-ad27-7b40c7e17120 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.747830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e90ab-5b6c-4926-ad27-7b40c7e17120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.766311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1244/2469] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:09.790915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5a7e90ab-5b6c-4926-ad27-7b40c7e17120 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:09.792266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a7e90ab-5b6c-4926-ad27-7b40c7e17120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.810237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1226/2470] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:09.811913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e76a-e9fd-4d0c-9c21-b0bd0196105c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.833703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1e76a-e9fd-4d0c-9c21-b0bd0196105c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.838982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.839661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.839939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.840207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.840874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:09.841609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.842905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.846204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c52488-ba68-45fd-a534-a86c765509cc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.847654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c52488-ba68-45fd-a534-a86c765509cc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.847654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c52488-ba68-45fd-a534-a86c765509cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.865586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1245/2471] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:09.867320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-53c52488-ba68-45fd-a534-a86c765509cc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:09.868864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-53c52488-ba68-45fd-a534-a86c765509cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:09.869449 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.877798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1227/2472] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:09.880606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45631-3590-4d4c-8b41-3c604babf366 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.882439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c52488-ba68-45fd-a534-a86c765509cc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.888185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.889269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.889592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.889928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.890860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.892755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c52488-ba68-45fd-a534-a86c765509cc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.893839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.898668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.899847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.900586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.900920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.901664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:09.901922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.903571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:09.916402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1228/2473] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:43:09.921425 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.925912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1246/2474] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:09 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:09.929955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:09.935496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8c77-552f-45e4-b844-e82c8155f6d0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.957340 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:09.983163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:09.995503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:09.996112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:09.996390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:09.996675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:09.997381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:09.997518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c8a6-bdff-4c09-bc8c-3ea8af97a3dd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:09.999459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.002758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.003381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.003646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.003916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.004542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.006526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.032657 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1229/2475] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:09 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:10.032869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1247/2476] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:09 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:10.033832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.033947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.043705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e70ff2-b4fd-4d8e-997c-2e5422c75763 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.096551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1aca5-671c-474c-ae61-0cc0379ce9fb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.101245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.101888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.102165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.102433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.103052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.104165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.104779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.104952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.105083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.105353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.106054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.107625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.118365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1248/2477] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:10.123020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.127159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1230/2478] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:10 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:10.131506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.134270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eba4f-f989-4a82-ac93-99821c435727 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.139203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.139815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.140088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.140353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.141051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.142008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83c9d4-3248-4cc1-a9df-58b7e009ef21 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.143704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.147848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.148496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.148786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.149050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.149750 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.151388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.157828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1249/2479] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:10.162152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.166673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1231/2480] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:10.167692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.172676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e689f2-54e5-4a53-a4e8-d698ce1a767e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.177382 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d1ac2-a3e7-42a8-ab84-ece2ff6dee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.177666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa982c3d-e0ff-4490-9eca-9a2b103e2519 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.178069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d1ac2-a3e7-42a8-ab84-ece2ff6dee58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.178353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d1ac2-a3e7-42a8-ab84-ece2ff6dee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.178632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d1ac2-a3e7-42a8-ab84-ece2ff6dee58 admin admin] PATH_INFO: `/v3/projects/2ff1e5d9411c4f0e9f11569e64e146cf/users/4d3c9c94e06d419baa37981e567e0c09/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.182423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.183013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.183285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.183553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.184235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.186066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.193480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d1ac2-a3e7-42a8-ab84-ece2ff6dee58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff1e5d9411c4f0e9f11569e64e146cf, user_id=4d3c9c94e06d419baa37981e567e0c09, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.196212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d1ac2-a3e7-42a8-ab84-ece2ff6dee58 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.196997 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1232/2481] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:10.201155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.210343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1250/2482] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:10 2022] PUT /identity/v3/projects/2ff1e5d9411c4f0e9f11569e64e146cf/users/4d3c9c94e06d419baa37981e567e0c09/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:10.220503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d26f0-1b80-4027-a282-1339988953e9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.221932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cba64-0d17-490c-9ffb-6624e9aa70b4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.222243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cba64-0d17-490c-9ffb-6624e9aa70b4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.222486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cba64-0d17-490c-9ffb-6624e9aa70b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.251720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f50cba64-0d17-490c-9ffb-6624e9aa70b4 None None] MFA Rules not processed for user `4d3c9c94e06d419baa37981e567e0c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:10.252954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f50cba64-0d17-490c-9ffb-6624e9aa70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:10.271667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8663a-066b-4922-9eb8-1e20b2de3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.272433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8663a-066b-4922-9eb8-1e20b2de3a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.272717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8663a-066b-4922-9eb8-1e20b2de3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.272987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8663a-066b-4922-9eb8-1e20b2de3a0b admin admin] PATH_INFO: `/v3/projects/7423b039f97941dabc8472a6ee2dcfa9/users/9b09fd3571d047819489f393c847103c/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.287726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8663a-066b-4922-9eb8-1e20b2de3a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7423b039f97941dabc8472a6ee2dcfa9, user_id=9b09fd3571d047819489f393c847103c, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.290415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8663a-066b-4922-9eb8-1e20b2de3a0b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.303727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1233/2483] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:10 2022] PUT /identity/v3/projects/7423b039f97941dabc8472a6ee2dcfa9/users/9b09fd3571d047819489f393c847103c/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:10.313523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.313827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.314092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.318114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1251/2484] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:10.322342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cba64-0d17-490c-9ffb-6624e9aa70b4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.328742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:10.332618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cba64-0d17-490c-9ffb-6624e9aa70b4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.345198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] MFA Rules not processed for user `9b09fd3571d047819489f393c847103c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:10.346444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:10.359754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:10.395847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.396576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.396851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.397114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.397780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.399703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.420551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1234/2485] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:10.431270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1252/2486] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:10 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:10.432951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.434556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:10.434991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.497453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa62ff-b8ca-4f03-a466-df43e8e7eb71 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.498499 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bb894-07fe-4046-b143-83dcf779c311 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.502096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.502697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.502973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.503239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.503857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.505949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.532717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1253/2487] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:10 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:10.534088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.544320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19f9f7-c66a-4693-9bff-15ecc2f5d9d2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.549016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.549632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.549907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.550103 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.550234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.550739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.550849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.551014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.551280 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.552403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.563472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1254/2488] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:10.567623 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.578127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f9b04-189d-48f9-a9c9-7a87758685fc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.582905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.583647 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.583809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.584075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] PATH_INFO: `/v3/projects/634a421e82d440128506d1efc6a83494/users/f980bd793df146ddbc0b4e85a72af049/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.599537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634a421e82d440128506d1efc6a83494, user_id=f980bd793df146ddbc0b4e85a72af049, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.602506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.607306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.608804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.617470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1255/2489] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:10 2022] PUT /identity/v3/projects/634a421e82d440128506d1efc6a83494/users/f980bd793df146ddbc0b4e85a72af049/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:10.619412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1235/2490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:10.621572 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.668612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:10.685149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898fd29-7782-4685-8501-57049b7a7b53 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.690195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9a044-bde7-481d-a5d2-94c7f5823a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.690792 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a044-bde7-481d-a5d2-94c7f5823a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.691126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a044-bde7-481d-a5d2-94c7f5823a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.691315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a044-bde7-481d-a5d2-94c7f5823a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.691947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9a044-bde7-481d-a5d2-94c7f5823a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.693698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9a044-bde7-481d-a5d2-94c7f5823a61 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.703827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1256/2491] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:10.708251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.719202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a3fa2-1f0d-441d-8702-1283f4680b3e service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.724125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.724776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.725052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.725320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] PATH_INFO: `/v3/projects/634a421e82d440128506d1efc6a83494/users/f980bd793df146ddbc0b4e85a72af049/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.727302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634a421e82d440128506d1efc6a83494, user_id=f980bd793df146ddbc0b4e85a72af049, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.730086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.741504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1236/2492] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:10 2022] PUT /identity/v3/projects/634a421e82d440128506d1efc6a83494/users/f980bd793df146ddbc0b4e85a72af049/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:10.752009 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec23748-44ee-40a6-a6d8-a63bcf1c70ae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.752297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec23748-44ee-40a6-a6d8-a63bcf1c70ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.752598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec23748-44ee-40a6-a6d8-a63bcf1c70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.783671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cec23748-44ee-40a6-a6d8-a63bcf1c70ae None None] MFA Rules not processed for user `f980bd793df146ddbc0b4e85a72af049`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:10.786504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cec23748-44ee-40a6-a6d8-a63bcf1c70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:10.856168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1257/2493] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:10.878073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:10.878073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:10.888954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:10.961806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd8378-1fa0-4a88-83c5-35aef657d939 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:10.966366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:10.967059 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:10.967395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:10.967733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:10.979006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:10.980445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:10.991778 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1237/2494] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:11.071490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec23748-44ee-40a6-a6d8-a63bcf1c70ae None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:11.081681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec23748-44ee-40a6-a6d8-a63bcf1c70ae None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:11.085231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b078b83-fde8-41e9-8b1f-2f2f2a1a2fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:11.085870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b078b83-fde8-41e9-8b1f-2f2f2a1a2fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:11.086146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b078b83-fde8-41e9-8b1f-2f2f2a1a2fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:11.086411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b078b83-fde8-41e9-8b1f-2f2f2a1a2fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:11.150498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b078b83-fde8-41e9-8b1f-2f2f2a1a2fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:11.151913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b078b83-fde8-41e9-8b1f-2f2f2a1a2fd2 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:11.162067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1258/2495] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:12.246129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:12.247651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:12.319045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8669a2-5289-4672-91fa-df5412718d07 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:12.325332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:12.325995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:12.326288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:12.326557 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] PATH_INFO: `/v3/users/d9926f6e80d54383b8849e77da22b2fd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:12.328071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9926f6e80d54383b8849e77da22b2fd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:12.330047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:12.389203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9926f6e80d54383b8849e77da22b2fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:12.390323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9926f6e80d54383b8849e77da22b2fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:12.401503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9926f6e80d54383b8849e77da22b2fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:12.413690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9926f6e80d54383b8849e77da22b2fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:12.414462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9926f6e80d54383b8849e77da22b2fd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:12.435382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1238/2496] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:12 2022] DELETE /identity/v3/users/d9926f6e80d54383b8849e77da22b2fd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:12.440133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:12.440621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:12.440784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:12.463444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:12.464684 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:12.569864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1259/2497] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:12.578810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:12.580619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:12.631355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:12.656032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a032568-aa4d-426a-b4e0-cc765abee893 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:12.663639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8099-18e5-4c5c-80c4-a38f1857bbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:12.664501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8099-18e5-4c5c-80c4-a38f1857bbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:12.664779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8099-18e5-4c5c-80c4-a38f1857bbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:12.665056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8099-18e5-4c5c-80c4-a38f1857bbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:12.676078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b8099-18e5-4c5c-80c4-a38f1857bbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:12.677809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b8099-18e5-4c5c-80c4-a38f1857bbe9 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:12.688639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1239/2498] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:12.971941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:12.973462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:12.982137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:12.990887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4538b5-72ca-4629-87cd-7339b7df3105 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:12.996955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:12.997640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:12.997931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:12.998196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] PATH_INFO: `/v3/projects/60f01e7804bb4805b0a4fbf67fbb5684` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:12.999414 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f01e7804bb4805b0a4fbf67fbb5684)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.001375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.051018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f01e7804bb4805b0a4fbf67fbb5684', 'request_id': 'req-14004f36-6d8a-4057-9704-99a7c43e5e67'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:13.058051 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f01e7804bb4805b0a4fbf67fbb5684', 'request_id': 'req-14004f36-6d8a-4057-9704-99a7c43e5e67'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:13.064079 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f01e7804bb4805b0a4fbf67fbb5684', 'request_id': 'req-14004f36-6d8a-4057-9704-99a7c43e5e67'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:13.079524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] The token cache is being invalidate because project 60f01e7804bb4805b0a4fbf67fbb5684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:13.079806 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:13.080479 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-14004f36-6d8a-4057-9704-99a7c43e5e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:13.082030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1260/2499] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:12 2022] DELETE /identity/v3/projects/60f01e7804bb4805b0a4fbf67fbb5684 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:13.088148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba5e3-c351-462e-aed3-a0e701b3d568 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.088431 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba5e3-c351-462e-aed3-a0e701b3d568 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.088698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba5e3-c351-462e-aed3-a0e701b3d568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.110224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b86ba5e3-c351-462e-aed3-a0e701b3d568 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:13.111758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b86ba5e3-c351-462e-aed3-a0e701b3d568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:13.174824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1240/2500] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:13.183751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74585af-f939-42d8-9daa-1dcb00fbb8fc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.184178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74585af-f939-42d8-9daa-1dcb00fbb8fc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.184510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74585af-f939-42d8-9daa-1dcb00fbb8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.208229 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d74585af-f939-42d8-9daa-1dcb00fbb8fc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:13.209523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d74585af-f939-42d8-9daa-1dcb00fbb8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:13.218503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1261/2501] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:13.222804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ba5e3-c351-462e-aed3-a0e701b3d568 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.232867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ba5e3-c351-462e-aed3-a0e701b3d568 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.238814 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.239465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.239744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.240033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.240667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:13.240972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.242637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.254770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1241/2502] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:13.259204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74585af-f939-42d8-9daa-1dcb00fbb8fc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.268857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74585af-f939-42d8-9daa-1dcb00fbb8fc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.274341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.274943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.275230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.275505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.276118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.278090 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.308304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1262/2503] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:13 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:13.314681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.329885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53303c50-802c-471b-8e90-6ea5a344e2b5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.388709 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.389313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.389593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.389885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.393943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.395919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.419398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1242/2504] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:13 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:13.423869 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.434530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c621ce-55e7-4254-a666-1ce0aa742ac3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.439599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.440199 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.440746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.440746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.441391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.443042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.453073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1263/2505] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:13.457181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.467688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66fc7-dd5a-45fa-88b0-9b8cc5376198 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.473172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02905625-ab1f-4d90-87b2-7455d4bd8cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.473735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905625-ab1f-4d90-87b2-7455d4bd8cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.474038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905625-ab1f-4d90-87b2-7455d4bd8cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.474303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02905625-ab1f-4d90-87b2-7455d4bd8cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.474941 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02905625-ab1f-4d90-87b2-7455d4bd8cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.476544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02905625-ab1f-4d90-87b2-7455d4bd8cb6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.487897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1243/2506] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:13.492020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.502633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc43ea-5f66-49be-8a6c-0912cb3d0b8f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.509106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.509802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.510083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.510354 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] PATH_INFO: `/v3/projects/b4bd87bee3c04c8988913880e1fa4878/users/140b7f8d4164415e8739c3e6d14b9a7e/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.525488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4bd87bee3c04c8988913880e1fa4878, user_id=140b7f8d4164415e8739c3e6d14b9a7e, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.528388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.544277 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1264/2507] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:13 2022] PUT /identity/v3/projects/b4bd87bee3c04c8988913880e1fa4878/users/140b7f8d4164415e8739c3e6d14b9a7e/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:13.556759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d295-ae85-4006-af35-6b2ac5e4860f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.556759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d295-ae85-4006-af35-6b2ac5e4860f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.556960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d295-ae85-4006-af35-6b2ac5e4860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.587467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bbd0d295-ae85-4006-af35-6b2ac5e4860f None None] MFA Rules not processed for user `140b7f8d4164415e8739c3e6d14b9a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:13.588685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bbd0d295-ae85-4006-af35-6b2ac5e4860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:13.631105 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:13.667516 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1244/2508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:13.672023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.745150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed3163-0907-499a-818d-2c940ac4fa1f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.749878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.750607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.751011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.751424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.751921 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.753844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.785070 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1265/2509] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:13 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:13.787020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d295-ae85-4006-af35-6b2ac5e4860f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.798327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d295-ae85-4006-af35-6b2ac5e4860f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.862715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.862875 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.863147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.863417 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.864046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.866184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.888717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1245/2510] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:13 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:13.892879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.903920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2b844-d509-4c70-b59a-fa747c87466f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.909943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.910651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.910931 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.911257 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.911974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.913729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.916358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:13.926211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1266/2511] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:13.931243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:13.945008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673abed-5282-416e-be16-06114af75d3e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:13.951837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:13.952556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:13.953045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:13.953316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] PATH_INFO: `/v3/projects/3cf9e1e79c7945b7863a838f86ce62e6/users/7a8c8c612ab3442ebcf4bb11925d936a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:13.969967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf9e1e79c7945b7863a838f86ce62e6, user_id=7a8c8c612ab3442ebcf4bb11925d936a, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:13.972694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:13.987090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1246/2512] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:13 2022] PUT /identity/v3/projects/3cf9e1e79c7945b7863a838f86ce62e6/users/7a8c8c612ab3442ebcf4bb11925d936a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:13.990993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:14.001313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7544f-8f13-40f5-b729-d81e13ba72a7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:14.059766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea58f3-eeaa-4ad1-88a3-e12f4d54b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:14.060367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea58f3-eeaa-4ad1-88a3-e12f4d54b524 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:14.060639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea58f3-eeaa-4ad1-88a3-e12f4d54b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:14.060905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea58f3-eeaa-4ad1-88a3-e12f4d54b524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:14.061562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea58f3-eeaa-4ad1-88a3-e12f4d54b524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:14.063160 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea58f3-eeaa-4ad1-88a3-e12f4d54b524 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:14.073655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1267/2513] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:14.078122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:14.089171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41a542-d46a-42e3-9835-37026117c01c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:14.094637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:14.095305 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:14.095613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:14.095967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] PATH_INFO: `/v3/projects/3cf9e1e79c7945b7863a838f86ce62e6/users/7a8c8c612ab3442ebcf4bb11925d936a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:14.098030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf9e1e79c7945b7863a838f86ce62e6, user_id=7a8c8c612ab3442ebcf4bb11925d936a, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:14.100736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:14.112937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1247/2514] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:14 2022] PUT /identity/v3/projects/3cf9e1e79c7945b7863a838f86ce62e6/users/7a8c8c612ab3442ebcf4bb11925d936a/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:14.123187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:14.123478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:14.123755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:14.155385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] MFA Rules not processed for user `7a8c8c612ab3442ebcf4bb11925d936a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:14.156659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:14.240484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1268/2515] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:14.252078 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:14.254199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:14.317896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87034-7b6f-4a05-a323-825494e06a26 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:14.321690 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:14.322303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:14.322618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:14.322876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:14.332594 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:14.334169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:14.345107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1248/2516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:14.430994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:14.432548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:14.445639 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d39a2-9dbc-4fc8-b155-cdf52686a6ae None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:14.449891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d36a1-a1be-48b7-9370-7381053ec75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:14.450521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d36a1-a1be-48b7-9370-7381053ec75e service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:14.450794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d36a1-a1be-48b7-9370-7381053ec75e service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:14.451060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d36a1-a1be-48b7-9370-7381053ec75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:14.513195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d36a1-a1be-48b7-9370-7381053ec75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:14.514554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d36a1-a1be-48b7-9370-7381053ec75e service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:14.523543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1269/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:17.269157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:17.270685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:17.305238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:17.341714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddc8b-083a-4fda-bc71-9a7c34d1629b service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:17.346479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:17.347189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:17.347530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:17.347866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] PATH_INFO: `/v3/users/4d3c9c94e06d419baa37981e567e0c09` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:17.349056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3c9c94e06d419baa37981e567e0c09)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:17.351215 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:17.421768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3c9c94e06d419baa37981e567e0c09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:17.421768 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3c9c94e06d419baa37981e567e0c09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:17.426321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3c9c94e06d419baa37981e567e0c09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:17.435713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3c9c94e06d419baa37981e567e0c09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:17.437592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3c9c94e06d419baa37981e567e0c09'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:17.468660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1249/2518] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:17 2022] DELETE /identity/v3/users/4d3c9c94e06d419baa37981e567e0c09 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:17.470404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:17.471352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:17.471789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:17.492467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:17.493815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:17.507956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:17.561716 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1270/2519] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:17.568170 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:17.569958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:17.655199 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e1da-6367-41f7-a21f-9451e8bc9d7e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:17.661088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:17.662497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:17.663269 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:17.663651 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:17.675849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:17.677389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:17.689230 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1250/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:17.980088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:17.981700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:17.996937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b13b89-8b1c-4de3-9479-65343adb819b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:18.003552 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:18.004544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:18.005182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:18.005577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] PATH_INFO: `/v3/projects/2ff1e5d9411c4f0e9f11569e64e146cf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:18.009485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff1e5d9411c4f0e9f11569e64e146cf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:18.010697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:18.062256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff1e5d9411c4f0e9f11569e64e146cf', 'request_id': 'req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.070669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff1e5d9411c4f0e9f11569e64e146cf', 'request_id': 'req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.077234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff1e5d9411c4f0e9f11569e64e146cf', 'request_id': 'req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.097201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] The token cache is being invalidate because project 2ff1e5d9411c4f0e9f11569e64e146cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:18.097593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.098266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.100121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1271/2521] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:17 2022] DELETE /identity/v3/projects/2ff1e5d9411c4f0e9f11569e64e146cf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:18.105349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:18.116253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8c1fc-aa76-48b7-bf31-3f76d37387f8 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:18.164218 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:18.177623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:18.178392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:18.178800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:18.179335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] PATH_INFO: `/v3/users/f980bd793df146ddbc0b4e85a72af049` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:18.181022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f980bd793df146ddbc0b4e85a72af049)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:18.183072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:18.239873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f980bd793df146ddbc0b4e85a72af049'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.240570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f980bd793df146ddbc0b4e85a72af049'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.248210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f980bd793df146ddbc0b4e85a72af049'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.257189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f980bd793df146ddbc0b4e85a72af049'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.257943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-21760569-8cdc-40ae-9e42-82fd21016896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f980bd793df146ddbc0b4e85a72af049'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.276640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1251/2522] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:18 2022] DELETE /identity/v3/users/f980bd793df146ddbc0b4e85a72af049 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:18.562826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:18.564410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:18.577462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84f5ba-e93c-4b3b-9200-e3e2d5e720e6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:18.636034 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:18.636666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:18.636947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:18.637247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] PATH_INFO: `/v3/projects/634a421e82d440128506d1efc6a83494` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:18.638419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634a421e82d440128506d1efc6a83494)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:18.640337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:18.689898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:18.694150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634a421e82d440128506d1efc6a83494', 'request_id': 'req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.703326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634a421e82d440128506d1efc6a83494', 'request_id': 'req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.708954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634a421e82d440128506d1efc6a83494', 'request_id': 'req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.721805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] The token cache is being invalidate because project 634a421e82d440128506d1efc6a83494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:18.722091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.722709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b26ad3b4-c2e3-4b78-9392-6fda5b8f74a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:18.724268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1272/2523] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:18 2022] DELETE /identity/v3/projects/634a421e82d440128506d1efc6a83494 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:18.729224 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31efdd-39d6-4eb1-945c-4348c542af59 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:18.729570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31efdd-39d6-4eb1-945c-4348c542af59 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:18.729924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31efdd-39d6-4eb1-945c-4348c542af59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:18.750374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7e31efdd-39d6-4eb1-945c-4348c542af59 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:18.751478 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e31efdd-39d6-4eb1-945c-4348c542af59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:18.814710 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1252/2524] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:18.823155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208be22-bb3e-4dfc-b789-6ecad0861bee None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:18.823535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208be22-bb3e-4dfc-b789-6ecad0861bee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:18.823691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208be22-bb3e-4dfc-b789-6ecad0861bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:18.844218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5208be22-bb3e-4dfc-b789-6ecad0861bee None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:18.845406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5208be22-bb3e-4dfc-b789-6ecad0861bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:18.854452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1273/2525] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:18.859353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31efdd-39d6-4eb1-945c-4348c542af59 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:18.870146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31efdd-39d6-4eb1-945c-4348c542af59 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:18.875335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:18.876149 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:18.876488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:18.876812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:18.877609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:18.877971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:18.879613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:18.892261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1253/2526] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:18.897020 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208be22-bb3e-4dfc-b789-6ecad0861bee None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:18.907363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208be22-bb3e-4dfc-b789-6ecad0861bee None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:18.913004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:18.913644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:18.913919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:18.914231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:18.914859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:18.916834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:18.946721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1274/2527] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:18 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:18.951530 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:18.962076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d60c5-4079-44e1-b1b2-5264bb15c730 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.013754 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:19.021399 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.022400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.023206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.023206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.023842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.027495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.065566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1254/2528] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:18 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:19.065917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.067668 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdb6f7-714d-4150-a986-477103b2129d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.072480 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.073085 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.073364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.073667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.074422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.075928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.087185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1275/2529] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:19.090971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.101320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25723b-c65f-42e4-82dd-6fd8eda03729 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.106481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f946ac-f3df-4ba7-bde8-39caee626542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.107086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f946ac-f3df-4ba7-bde8-39caee626542 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.107367 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f946ac-f3df-4ba7-bde8-39caee626542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.107655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f946ac-f3df-4ba7-bde8-39caee626542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.108288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f946ac-f3df-4ba7-bde8-39caee626542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.109979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f946ac-f3df-4ba7-bde8-39caee626542 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.121128 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1255/2530] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:19.125405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.136107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74716-0aec-43d2-9ea3-d76962249c24 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.141816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.142607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.142978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.143562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] PATH_INFO: `/v3/projects/c73be701e60f4c329c3130f201cab987/users/a2f77a44bd304767ac441bcfae8f570d/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.160038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73be701e60f4c329c3130f201cab987, user_id=a2f77a44bd304767ac441bcfae8f570d, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.162846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.177915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1276/2531] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:19 2022] PUT /identity/v3/projects/c73be701e60f4c329c3130f201cab987/users/a2f77a44bd304767ac441bcfae8f570d/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:19.190361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.190545 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.191042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.222591 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] MFA Rules not processed for user `a2f77a44bd304767ac441bcfae8f570d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:19.223816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:19.311671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1256/2532] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:19.312870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.396877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e759ce1-37ea-4dbf-a9f8-e431f7af60e8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.401136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.401830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.402127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.402406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.403153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.405080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.413774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.415315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:19.429836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224eaa8-c2a0-4b6d-96c3-7de33a8fd758 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.434574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1277/2533] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:19 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:19.434738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.435198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.435511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.435784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] PATH_INFO: `/v3/users/140b7f8d4164415e8739c3e6d14b9a7e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.436924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] RBAC: Authorizing `identity:delete_user(user_id=140b7f8d4164415e8739c3e6d14b9a7e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.438556 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.439023 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.488664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140b7f8d4164415e8739c3e6d14b9a7e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:19.489452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140b7f8d4164415e8739c3e6d14b9a7e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:19.492958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:19.497826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140b7f8d4164415e8739c3e6d14b9a7e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:19.504724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3faf4-23df-4473-90d0-778b3199a648 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.507882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140b7f8d4164415e8739c3e6d14b9a7e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:19.508557 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f8bde15b-daaa-4844-8708-c9e6b9eb824f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140b7f8d4164415e8739c3e6d14b9a7e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:19.511930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.512620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.512906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.513180 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.513859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.515793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.526850 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1257/2534] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:19 2022] DELETE /identity/v3/users/140b7f8d4164415e8739c3e6d14b9a7e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:19.531220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.531508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.531809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.537857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1278/2535] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:19 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:19.541977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.543641 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:19.551627 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:19.552812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:19.556555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee3cb-faae-498f-8d76-79c31fc84a61 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.588235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:19.618030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.618651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.618981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.619283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.619697 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1258/2536] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:19.619951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.621599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.629859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.631411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:19.635251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1279/2537] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:19.636327 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.646347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731ce88-f0f4-4692-957b-c3d0357cdf49 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.650984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.651614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.651877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.652149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] PATH_INFO: `/v3/projects/8ab391bc9eed4ff2bce2401b04860b3e/users/2f0cfaac7ec140149743334dc48a8ec4/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.667894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab391bc9eed4ff2bce2401b04860b3e, user_id=2f0cfaac7ec140149743334dc48a8ec4, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.670573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.684574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1280/2538] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:19 2022] PUT /identity/v3/projects/8ab391bc9eed4ff2bce2401b04860b3e/users/2f0cfaac7ec140149743334dc48a8ec4/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:19.688547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.691348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579bc17-de4c-4f93-8cae-6e65cc7b72ff None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.739963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.740570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.740856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.741124 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.750672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.751023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce77f-14b0-4b09-b649-6bb7ac3d1c7c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.752174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.755912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce13bb9-d150-46aa-be3c-59d9e8084393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.756509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13bb9-d150-46aa-be3c-59d9e8084393 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.756785 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13bb9-d150-46aa-be3c-59d9e8084393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.757052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13bb9-d150-46aa-be3c-59d9e8084393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.757712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce13bb9-d150-46aa-be3c-59d9e8084393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.759291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce13bb9-d150-46aa-be3c-59d9e8084393 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.762191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1259/2539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:19.769307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1281/2540] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:19.773465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.783201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a141b-b6ed-45bf-8a9b-cb5209ef86d2 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:19.788026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:19.788673 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.788952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.789353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] PATH_INFO: `/v3/projects/8ab391bc9eed4ff2bce2401b04860b3e/users/2f0cfaac7ec140149743334dc48a8ec4/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.791293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab391bc9eed4ff2bce2401b04860b3e, user_id=2f0cfaac7ec140149743334dc48a8ec4, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:19.796322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:19.815407 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1260/2541] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:19 2022] PUT /identity/v3/projects/8ab391bc9eed4ff2bce2401b04860b3e/users/2f0cfaac7ec140149743334dc48a8ec4/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:19.826095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:19.826470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:19.826812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:19.866925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] MFA Rules not processed for user `2f0cfaac7ec140149743334dc48a8ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:19.868183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:19.912432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:19.950837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1282/2542] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:19.961917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:19.963769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:20.022644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ce686-5842-47d4-b2b9-f303fe47b13a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:20.027229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:20.027877 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:20.028132 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:20.028418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:20.039412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:20.041166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:20.048621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:20.050435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:20.053448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1261/2543] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:20.125995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97900e-8974-4958-9108-9cb612ad2eb5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:20.130886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:20.131952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:20.131952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:20.132132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] PATH_INFO: `/v3/projects/b4bd87bee3c04c8988913880e1fa4878` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:20.133422 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4bd87bee3c04c8988913880e1fa4878)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:20.135348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:20.184358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4bd87bee3c04c8988913880e1fa4878', 'request_id': 'req-3637d894-a4e4-45ee-8301-21314dac6d15'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.191026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4bd87bee3c04c8988913880e1fa4878', 'request_id': 'req-3637d894-a4e4-45ee-8301-21314dac6d15'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.197610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4bd87bee3c04c8988913880e1fa4878', 'request_id': 'req-3637d894-a4e4-45ee-8301-21314dac6d15'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.211063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] The token cache is being invalidate because project b4bd87bee3c04c8988913880e1fa4878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:20.211332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.212026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.213808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1283/2544] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:20 2022] DELETE /identity/v3/projects/b4bd87bee3c04c8988913880e1fa4878 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:20.217537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:20.229758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9145-90eb-47f8-8a5d-d174fea14122 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:20.254590 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:20.295593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:20.296159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:20.296433 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:20.296731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] PATH_INFO: `/v3/users/7a8c8c612ab3442ebcf4bb11925d936a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:20.297883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8c8c612ab3442ebcf4bb11925d936a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:20.300313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:20.352527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8c8c612ab3442ebcf4bb11925d936a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.352527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8c8c612ab3442ebcf4bb11925d936a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.357763 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8c8c612ab3442ebcf4bb11925d936a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.367266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8c8c612ab3442ebcf4bb11925d936a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.368062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8500f933-3fa1-46ab-b461-8bab2a652806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8c8c612ab3442ebcf4bb11925d936a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.401582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1262/2545] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:20 2022] DELETE /identity/v3/users/7a8c8c612ab3442ebcf4bb11925d936a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:20.723916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:20.726072 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:20.739535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637d894-a4e4-45ee-8301-21314dac6d15 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:20.806152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:20.806783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:20.807075 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:20.807401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] PATH_INFO: `/v3/projects/3cf9e1e79c7945b7863a838f86ce62e6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:20.808433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf9e1e79c7945b7863a838f86ce62e6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:20.810428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:20.819686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:20.862891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf9e1e79c7945b7863a838f86ce62e6', 'request_id': 'req-eed083e3-abd5-46db-aa8e-9d878e0a7cca'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.869201 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf9e1e79c7945b7863a838f86ce62e6', 'request_id': 'req-eed083e3-abd5-46db-aa8e-9d878e0a7cca'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.876754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf9e1e79c7945b7863a838f86ce62e6', 'request_id': 'req-eed083e3-abd5-46db-aa8e-9d878e0a7cca'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.892413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] The token cache is being invalidate because project 3cf9e1e79c7945b7863a838f86ce62e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:20.892728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.893369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eed083e3-abd5-46db-aa8e-9d878e0a7cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:20.896087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1284/2546] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:20 2022] DELETE /identity/v3/projects/3cf9e1e79c7945b7863a838f86ce62e6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:20.901570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f8f5-eb68-455d-a1ca-b71959f763d4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:20.901873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f8f5-eb68-455d-a1ca-b71959f763d4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:20.902150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f8f5-eb68-455d-a1ca-b71959f763d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:20.923117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5ee9f8f5-eb68-455d-a1ca-b71959f763d4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:20.925949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ee9f8f5-eb68-455d-a1ca-b71959f763d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:20.990232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1263/2547] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:20.998288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2914bf-a2b9-4098-9289-f918c5c776f0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:20.998796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2914bf-a2b9-4098-9289-f918c5c776f0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:20.998953 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2914bf-a2b9-4098-9289-f918c5c776f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.020065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4c2914bf-a2b9-4098-9289-f918c5c776f0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:21.021431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4c2914bf-a2b9-4098-9289-f918c5c776f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:21.029471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1285/2548] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:21.034160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9f8f5-eb68-455d-a1ca-b71959f763d4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.044262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9f8f5-eb68-455d-a1ca-b71959f763d4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.049326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.049975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.050253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.050520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.051169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:21.051493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.053161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.070084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1264/2549] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:21.071193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2914bf-a2b9-4098-9289-f918c5c776f0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.081059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2914bf-a2b9-4098-9289-f918c5c776f0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.085820 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.086544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.086822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.087211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.087915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.089905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.124330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1286/2550] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:21 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:21.125920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.137014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f1dd7-35d0-4acd-83c6-4d4145f020ff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.168745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:21.198483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.199089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.199368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.199637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.200258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.202206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.229505 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1265/2551] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:21 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:21.230784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.242076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce4ff9-c782-4649-9779-6cb9cf43b571 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.247913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.248538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.248814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.249081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.249804 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.251391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.264571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1287/2552] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:21.265833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.276001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d0f7f-e77c-42dc-b6a6-37435a5dab83 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.284192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502026-9a4d-4638-8016-7294773c2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.284810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502026-9a4d-4638-8016-7294773c2874 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.285090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502026-9a4d-4638-8016-7294773c2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.285363 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502026-9a4d-4638-8016-7294773c2874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.286042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61502026-9a4d-4638-8016-7294773c2874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.287654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61502026-9a4d-4638-8016-7294773c2874 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.300202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1266/2553] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:21.304166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.314084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f33d78-f339-4356-802a-821eaeafce42 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.319286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.319933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.320211 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.320490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] PATH_INFO: `/v3/projects/31cad18164984aa393b540560a6433ea/users/6d29108eb96e4bf699a7387406ca62ab/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.336120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cad18164984aa393b540560a6433ea, user_id=6d29108eb96e4bf699a7387406ca62ab, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.338907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.354181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1288/2554] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:21 2022] PUT /identity/v3/projects/31cad18164984aa393b540560a6433ea/users/6d29108eb96e4bf699a7387406ca62ab/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:21.369536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.369536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.369536 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.399986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] MFA Rules not processed for user `6d29108eb96e4bf699a7387406ca62ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:21.401204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:21.465935 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1267/2555] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:21.477673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.480415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:21.506755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.508120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:21.539282 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fccf01-f5ae-44ba-9b57-9b3159868514 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.543675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05d964-12dd-46ce-96cc-293df375fcce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.544291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05d964-12dd-46ce-96cc-293df375fcce service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.544569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05d964-12dd-46ce-96cc-293df375fcce service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.544834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05d964-12dd-46ce-96cc-293df375fcce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.554256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05d964-12dd-46ce-96cc-293df375fcce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.555911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05d964-12dd-46ce-96cc-293df375fcce service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.565430 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1289/2556] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:21.574936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff73e-0d6d-4a39-a938-ba701d00f229 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.580395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.581033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.581309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.581602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] PATH_INFO: `/v3/users/a2f77a44bd304767ac441bcfae8f570d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.582947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f77a44bd304767ac441bcfae8f570d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.584910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.638427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:21.641701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f77a44bd304767ac441bcfae8f570d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:21.642392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f77a44bd304767ac441bcfae8f570d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:21.652957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f77a44bd304767ac441bcfae8f570d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:21.662210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f77a44bd304767ac441bcfae8f570d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:21.663238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f77a44bd304767ac441bcfae8f570d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:21.684806 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1268/2557] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:21 2022] DELETE /identity/v3/users/a2f77a44bd304767ac441bcfae8f570d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:21.689665 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.690341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.690689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.716610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:21.717990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:21.754030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:21.787852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1290/2558] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:21.801197 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:21.802764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:21.872733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ab5dd-d153-4843-95f4-aa02f4668de7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:21.877186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:21.877905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:21.878362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:21.878480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:21.888572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:21.890056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:21.900306 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1269/2559] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:22.188959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:22.190708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:22.203694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e39ef-26ee-4eea-a361-3691ed40a7f7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:22.209228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:22.209910 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:22.210185 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:22.210468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] PATH_INFO: `/v3/projects/c73be701e60f4c329c3130f201cab987` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:22.211750 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73be701e60f4c329c3130f201cab987)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:22.213732 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:22.270642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73be701e60f4c329c3130f201cab987', 'request_id': 'req-a37b885c-4f43-47ee-a840-f0acedefc7df'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.277120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73be701e60f4c329c3130f201cab987', 'request_id': 'req-a37b885c-4f43-47ee-a840-f0acedefc7df'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.284488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73be701e60f4c329c3130f201cab987', 'request_id': 'req-a37b885c-4f43-47ee-a840-f0acedefc7df'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.301614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] The token cache is being invalidate because project c73be701e60f4c329c3130f201cab987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:22.301901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.302524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.304021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1291/2560] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:22 2022] DELETE /identity/v3/projects/c73be701e60f4c329c3130f201cab987 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:22.308232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:22.318285 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1eccbc-7f67-4c25-8c3e-0b1b1eafe481 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:22.384178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:22.384868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:22.385100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:22.385374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] PATH_INFO: `/v3/users/2f0cfaac7ec140149743334dc48a8ec4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:22.386621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0cfaac7ec140149743334dc48a8ec4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:22.388729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:22.441257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0cfaac7ec140149743334dc48a8ec4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.441928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0cfaac7ec140149743334dc48a8ec4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.448732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0cfaac7ec140149743334dc48a8ec4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.457133 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0cfaac7ec140149743334dc48a8ec4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.457856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-98fc4879-6564-4aad-bfdf-19924d12e905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0cfaac7ec140149743334dc48a8ec4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.459988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:22.480361 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1270/2561] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:22 2022] DELETE /identity/v3/users/2f0cfaac7ec140149743334dc48a8ec4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:22.764923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:22.766504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:22.791392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b885c-4f43-47ee-a840-f0acedefc7df admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:22.852024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:22.852660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:22.853379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:22.853721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] PATH_INFO: `/v3/projects/8ab391bc9eed4ff2bce2401b04860b3e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:22.854906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab391bc9eed4ff2bce2401b04860b3e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:22.856808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:22.908734 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab391bc9eed4ff2bce2401b04860b3e', 'request_id': 'req-3d0cf8c8-3d4c-4062-8b76-492199877cc9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.917265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab391bc9eed4ff2bce2401b04860b3e', 'request_id': 'req-3d0cf8c8-3d4c-4062-8b76-492199877cc9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.923275 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:22.925088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab391bc9eed4ff2bce2401b04860b3e', 'request_id': 'req-3d0cf8c8-3d4c-4062-8b76-492199877cc9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.941049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] The token cache is being invalidate because project 8ab391bc9eed4ff2bce2401b04860b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:22.941611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.942458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3d0cf8c8-3d4c-4062-8b76-492199877cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:22.944505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1292/2562] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:22 2022] DELETE /identity/v3/projects/8ab391bc9eed4ff2bce2401b04860b3e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:22.949204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec62b-9267-42b1-b7e7-c55bcd89a221 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:22.949486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec62b-9267-42b1-b7e7-c55bcd89a221 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:22.949786 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eec62b-9267-42b1-b7e7-c55bcd89a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:22.983523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-04eec62b-9267-42b1-b7e7-c55bcd89a221 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:22.984857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-04eec62b-9267-42b1-b7e7-c55bcd89a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:23.055906 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1271/2563] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:23.064197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfae9e-c4a7-4307-954f-649aa6f308b4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.064545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfae9e-c4a7-4307-954f-649aa6f308b4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.064882 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfae9e-c4a7-4307-954f-649aa6f308b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.092268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fccfae9e-c4a7-4307-954f-649aa6f308b4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:23.093631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fccfae9e-c4a7-4307-954f-649aa6f308b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:23.102112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1293/2564] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:23.108862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec62b-9267-42b1-b7e7-c55bcd89a221 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.124628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eec62b-9267-42b1-b7e7-c55bcd89a221 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.129501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.130213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.130568 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.130898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.131711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:23.132006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.133616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.148222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1272/2565] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:43:23.152886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfae9e-c4a7-4307-954f-649aa6f308b4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.163621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfae9e-c4a7-4307-954f-649aa6f308b4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.169192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.169748 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.170010 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.170270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.170911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.172839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.212703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1294/2566] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:23 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:23.217312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.234522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f54-0b8c-4eae-af03-f32ec0901c87 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.313783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.314395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.314676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.314949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.315579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.317497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.341017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1273/2567] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:23 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:23.345218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.355624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce765ef-4fb4-475a-bcf8-09c83f3b2ca1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.360363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.361303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.361592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.361863 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.362501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.364074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.375413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1295/2568] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:23.379549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.393998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f47638-1a7f-47cc-ac35-0387d09e5332 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.399445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de604ef4-d2fd-4753-9bb6-1d7cdb36b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.400250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604ef4-d2fd-4753-9bb6-1d7cdb36b1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.400533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604ef4-d2fd-4753-9bb6-1d7cdb36b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.400802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de604ef4-d2fd-4753-9bb6-1d7cdb36b1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.401514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de604ef4-d2fd-4753-9bb6-1d7cdb36b1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.403219 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de604ef4-d2fd-4753-9bb6-1d7cdb36b1d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.419721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1274/2569] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:23.421640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.434152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44046ab-5cb8-4a12-a7f7-94e70168fbb5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.439375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.440069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.440385 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.440659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] PATH_INFO: `/v3/projects/9f573e5937db4e21a61dc78721e4304e/users/39828766c08c41558372cbec64877443/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.459575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f573e5937db4e21a61dc78721e4304e, user_id=39828766c08c41558372cbec64877443, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.462403 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.482606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1296/2570] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:23 2022] PUT /identity/v3/projects/9f573e5937db4e21a61dc78721e4304e/users/39828766c08c41558372cbec64877443/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:23.493701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e560be-96ec-4f81-a1b2-c2b3843d0581 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.493984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e560be-96ec-4f81-a1b2-c2b3843d0581 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.494255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e560be-96ec-4f81-a1b2-c2b3843d0581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.527881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d2e560be-96ec-4f81-a1b2-c2b3843d0581 None None] MFA Rules not processed for user `39828766c08c41558372cbec64877443`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:23.529154 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d2e560be-96ec-4f81-a1b2-c2b3843d0581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:23.573160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:23.609999 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1275/2571] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:23.614899 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.692563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46b6a7-43e9-4e0c-9f60-00e9fcb2641f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.697636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.698538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.698817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.699083 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.699747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.701653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.730128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1297/2572] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:23 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:23.734293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e560be-96ec-4f81-a1b2-c2b3843d0581 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.746108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e560be-96ec-4f81-a1b2-c2b3843d0581 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.812995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.813721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.813985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.814271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.815202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.817193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.841204 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1276/2573] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:23 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:23.845437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.855958 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c367f-e2d6-421c-a274-1a74ccc05449 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.861326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.861963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.862245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.862516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.863157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.864853 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.877164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1298/2574] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:23.881454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.892551 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706b427-04b5-404a-81ff-9948657c7857 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:23.898054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:23.898704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:23.898983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:23.899250 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] PATH_INFO: `/v3/projects/d369902e7de74e4399c35e90125e6809/users/514a5055a1ef40adbe469affc1352785/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:23.916052 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d369902e7de74e4399c35e90125e6809, user_id=514a5055a1ef40adbe469affc1352785, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:23.918735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:23.933872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1277/2575] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:23 2022] PUT /identity/v3/projects/d369902e7de74e4399c35e90125e6809/users/514a5055a1ef40adbe469affc1352785/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:23.937939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:23.948499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac949017-c6ef-489f-8c09-f5fc3aaf2c17 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:24.010984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996575bb-fbe8-48f1-b266-8c65474bf442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:24.011704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996575bb-fbe8-48f1-b266-8c65474bf442 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:24.011992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996575bb-fbe8-48f1-b266-8c65474bf442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:24.012267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996575bb-fbe8-48f1-b266-8c65474bf442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:24.012911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996575bb-fbe8-48f1-b266-8c65474bf442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:24.014786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996575bb-fbe8-48f1-b266-8c65474bf442 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:24.016145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:24.026667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1299/2576] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:24.031172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:24.044153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6b09c-4962-4eb8-9ab6-c11d345676b5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:24.050944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:24.051616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:24.051899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:24.052335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] PATH_INFO: `/v3/projects/d369902e7de74e4399c35e90125e6809/users/514a5055a1ef40adbe469affc1352785/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:24.054669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d369902e7de74e4399c35e90125e6809, user_id=514a5055a1ef40adbe469affc1352785, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:24.058106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:24.073291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1278/2577] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:24 2022] PUT /identity/v3/projects/d369902e7de74e4399c35e90125e6809/users/514a5055a1ef40adbe469affc1352785/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:24.084881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:24.085300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:24.085690 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:24.119115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] MFA Rules not processed for user `514a5055a1ef40adbe469affc1352785`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:24.120270 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:24.201102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1300/2578] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:24.213279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:24.215242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:24.278807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb3501-229c-4852-9f7a-111eb102a9d2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:24.283476 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca04987-76d3-4c08-a8fa-6a347012f03a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:24.284253 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca04987-76d3-4c08-a8fa-6a347012f03a service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:24.284523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca04987-76d3-4c08-a8fa-6a347012f03a service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:24.284777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca04987-76d3-4c08-a8fa-6a347012f03a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:24.332473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:24.354522 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca04987-76d3-4c08-a8fa-6a347012f03a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:24.356007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca04987-76d3-4c08-a8fa-6a347012f03a service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:24.365302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1279/2579] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:24.741857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:24.743477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:24.811477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405790-522c-4620-aad7-be2fe5d974ac None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:24.816847 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:24.817475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:24.817787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:24.818062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] PATH_INFO: `/v3/users/6d29108eb96e4bf699a7387406ca62ab` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:24.819304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d29108eb96e4bf699a7387406ca62ab)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:24.821241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:24.867890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d29108eb96e4bf699a7387406ca62ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:24.880438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d29108eb96e4bf699a7387406ca62ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:24.887920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d29108eb96e4bf699a7387406ca62ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:24.888705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d29108eb96e4bf699a7387406ca62ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:24.889363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d29108eb96e4bf699a7387406ca62ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:24.899458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:24.904338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1301/2580] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:24 2022] DELETE /identity/v3/users/6d29108eb96e4bf699a7387406ca62ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:24.909703 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:24.910194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:24.910315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:24.929951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:24.931070 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:24.994486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1280/2581] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:25.004652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.006139 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:25.069326 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07aeae-d117-4d6a-a2ac-793f1f1c2ec3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.073577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920380-6499-4eab-b0b0-befa5b31e9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.074436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920380-6499-4eab-b0b0-befa5b31e9cc service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.074827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920380-6499-4eab-b0b0-befa5b31e9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.075129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920380-6499-4eab-b0b0-befa5b31e9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.086310 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920380-6499-4eab-b0b0-befa5b31e9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.087747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920380-6499-4eab-b0b0-befa5b31e9cc service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.098061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1302/2582] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:25.383441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.387271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:25.404108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7519eb-7016-45bd-baf9-6dd9aabf2fd5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.409188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.409858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.410135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.410401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] PATH_INFO: `/v3/projects/31cad18164984aa393b540560a6433ea` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.411675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cad18164984aa393b540560a6433ea)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.413566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.461938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cad18164984aa393b540560a6433ea', 'request_id': 'req-6bd27755-387b-42df-aeae-7ec473cba0af'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:25.467555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cad18164984aa393b540560a6433ea', 'request_id': 'req-6bd27755-387b-42df-aeae-7ec473cba0af'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:25.478939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cad18164984aa393b540560a6433ea', 'request_id': 'req-6bd27755-387b-42df-aeae-7ec473cba0af'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:25.493158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] The token cache is being invalidate because project 31cad18164984aa393b540560a6433ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:25.493449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:25.494222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6bd27755-387b-42df-aeae-7ec473cba0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:25.495852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1281/2583] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:25 2022] DELETE /identity/v3/projects/31cad18164984aa393b540560a6433ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:25.501080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da583c-5284-4eaf-863c-8f3d43ae7273 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.501364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da583c-5284-4eaf-863c-8f3d43ae7273 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.501664 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da583c-5284-4eaf-863c-8f3d43ae7273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.522908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-28da583c-5284-4eaf-863c-8f3d43ae7273 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:25.524203 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-28da583c-5284-4eaf-863c-8f3d43ae7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:25.592886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1303/2584] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:25.601259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c1c2b-47d1-4212-930a-683c899ec8f5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.601579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c1c2b-47d1-4212-930a-683c899ec8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.601888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c1c2b-47d1-4212-930a-683c899ec8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.624491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5e0c1c2b-47d1-4212-930a-683c899ec8f5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:25.625794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e0c1c2b-47d1-4212-930a-683c899ec8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:25.634988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1282/2585] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:25.640143 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da583c-5284-4eaf-863c-8f3d43ae7273 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.653386 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da583c-5284-4eaf-863c-8f3d43ae7273 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.659319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.660016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.660328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.660649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.661291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:25.661605 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.663700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.681245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1304/2586] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:25.682541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c1c2b-47d1-4212-930a-683c899ec8f5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.692021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c1c2b-47d1-4212-930a-683c899ec8f5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.697163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.697802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.698080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.698346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.698991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.700863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.745144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1283/2587] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:25 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:25.746783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.758099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32675791-9841-4e3a-9cde-1e2e4fd5b719 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.818224 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.818962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.819289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.819621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.820472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.822872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.846810 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1305/2588] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:25 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:25.850838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.861604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c78462-8912-4ab0-91a8-fac98bfd5117 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.866412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.867012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.867288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.867558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.868201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.869822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.880726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1284/2589] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:25.885232 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.897682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93f409-b5d7-40b0-82d7-4badf16fb344 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.905961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a1589-72e2-4f83-ae7b-8bcb78b9aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.905961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1589-72e2-4f83-ae7b-8bcb78b9aedb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.905961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1589-72e2-4f83-ae7b-8bcb78b9aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.905961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a1589-72e2-4f83-ae7b-8bcb78b9aedb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.907365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a1589-72e2-4f83-ae7b-8bcb78b9aedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.908694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a1589-72e2-4f83-ae7b-8bcb78b9aedb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.921903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1306/2590] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:25.926245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:25.940114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6c30-9b06-46c6-9676-59f1fadc8fda admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:25.944853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:25.945503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.945824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.946089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] PATH_INFO: `/v3/projects/c007e55a889f4319974197491ef1d554/users/42739d5104264e78a5f55e0ce367fcd1/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:25.962804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c007e55a889f4319974197491ef1d554, user_id=42739d5104264e78a5f55e0ce367fcd1, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:25.965606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:25.979672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1285/2591] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:25 2022] PUT /identity/v3/projects/c007e55a889f4319974197491ef1d554/users/42739d5104264e78a5f55e0ce367fcd1/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:25.991590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9b063-9120-42ce-b8cd-b97b701a523f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:25.991872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9b063-9120-42ce-b8cd-b97b701a523f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:25.992140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9b063-9120-42ce-b8cd-b97b701a523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.011801 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:26.022021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-11f9b063-9120-42ce-b8cd-b97b701a523f None None] MFA Rules not processed for user `42739d5104264e78a5f55e0ce367fcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:26.024074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-11f9b063-9120-42ce-b8cd-b97b701a523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:26.094005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1307/2592] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:26.098542 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.105021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:26.174123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d70c46-078a-4123-af94-aa48a85d1835 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.179489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.180092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.180368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.180638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.181299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.183409 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.214354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1286/2593] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:26 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:26.218759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9b063-9120-42ce-b8cd-b97b701a523f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.231006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9b063-9120-42ce-b8cd-b97b701a523f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.295476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.296184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.296457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.296723 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.297399 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.299724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.324413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1308/2594] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:26 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:26.330045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.343876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d0a93-8133-49ba-b70e-da631456527e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.350014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.350751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.351036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.351291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.351934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.353570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.365848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1287/2595] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:26.370104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.382027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1738-20b0-4f18-8d61-e182fd4426ec admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.387190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42946f-238b-4f3c-a96d-a85ca87576a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.388263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42946f-238b-4f3c-a96d-a85ca87576a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.388263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42946f-238b-4f3c-a96d-a85ca87576a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.388461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42946f-238b-4f3c-a96d-a85ca87576a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.389002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42946f-238b-4f3c-a96d-a85ca87576a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.390660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42946f-238b-4f3c-a96d-a85ca87576a9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.402273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1309/2596] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:26.406868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.418226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b7746-415c-478b-bc0f-a4da733b3c37 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.423937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.424587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.424868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.425141 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] PATH_INFO: `/v3/projects/7ac7f52e6b434969b0c2d005945f8ab5/users/c60c297c5f114eebbbff82e686ab0abe/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.441954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac7f52e6b434969b0c2d005945f8ab5, user_id=c60c297c5f114eebbbff82e686ab0abe, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.444991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.460289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1288/2597] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:26 2022] PUT /identity/v3/projects/7ac7f52e6b434969b0c2d005945f8ab5/users/c60c297c5f114eebbbff82e686ab0abe/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:26.470946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce857-d1fb-4469-96e7-4c0aac44d47c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.471248 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce857-d1fb-4469-96e7-4c0aac44d47c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.471526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ce857-d1fb-4469-96e7-4c0aac44d47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.510023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f26ce857-d1fb-4469-96e7-4c0aac44d47c None None] MFA Rules not processed for user `c60c297c5f114eebbbff82e686ab0abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:26.511198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f26ce857-d1fb-4469-96e7-4c0aac44d47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:26.584865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1310/2598] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:26.589596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.654286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ae00b-666c-477d-a9df-3d86d4de9a1b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.659311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.659902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.660175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.660440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.661048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.662959 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.692520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1289/2599] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:26 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:26.696794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ce857-d1fb-4469-96e7-4c0aac44d47c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.707861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ce857-d1fb-4469-96e7-4c0aac44d47c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.711584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:26.775653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.776181 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.776457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.776728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.777461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.779755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.802778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1311/2600] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:26 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:26.807927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.824486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e93a31-0b1f-45d4-811a-56bdbe4582ee admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.831212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.831815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.832089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.832354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.832988 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.834622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.846195 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1290/2601] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:26.852437 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.863902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298af5c-5a99-47f4-af6e-aba254089e64 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.869301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:26.869983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:26.870263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:26.870536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] PATH_INFO: `/v3/projects/1c76468ce67d4cb8b5cc60864189e3fb/users/225ad94fe2124d4998acbdc4c9d0becc/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:26.886916 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c76468ce67d4cb8b5cc60864189e3fb, user_id=225ad94fe2124d4998acbdc4c9d0becc, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:26.890477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:26.906887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1312/2602] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:26 2022] PUT /identity/v3/projects/1c76468ce67d4cb8b5cc60864189e3fb/users/225ad94fe2124d4998acbdc4c9d0becc/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:26.911819 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.925336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c87dcc-b28a-4a82-9c77-de51b8564c06 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:26.965239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:26.975148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:26.976930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:27.000559 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:27.001150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:27.001430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:27.001872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:27.002543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:27.004214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:27.015395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1291/2603] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:27.019572 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:27.030031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ddad9-7c37-4886-acae-fc16322de2fc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:27.035649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4b90e-13c1-4d1f-9084-cbe82f510c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:27.036295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4b90e-13c1-4d1f-9084-cbe82f510c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:27.036597 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4b90e-13c1-4d1f-9084-cbe82f510c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:27.036872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4b90e-13c1-4d1f-9084-cbe82f510c4e admin admin] PATH_INFO: `/v3/projects/1c76468ce67d4cb8b5cc60864189e3fb/users/225ad94fe2124d4998acbdc4c9d0becc/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:27.038857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4b90e-13c1-4d1f-9084-cbe82f510c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c76468ce67d4cb8b5cc60864189e3fb, user_id=225ad94fe2124d4998acbdc4c9d0becc, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:27.041496 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4b90e-13c1-4d1f-9084-cbe82f510c4e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:27.042290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41617be2-e963-4f60-9d12-1de77420d0d6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:27.045920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:27.046678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:27.046998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:27.047318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:27.049198 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:27.058021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1292/2604] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:27 2022] PUT /identity/v3/projects/1c76468ce67d4cb8b5cc60864189e3fb/users/225ad94fe2124d4998acbdc4c9d0becc/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:27.063560 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:27.063849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:27.064123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:27.093427 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] MFA Rules not processed for user `225ad94fe2124d4998acbdc4c9d0becc`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:27.094741 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:27.119632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:27.121060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:27.130859 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1313/2605] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:27.175494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1293/2606] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:27.187025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:27.188510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:27.200158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46261-5fc5-4c68-9b38-a0fa4fbfa368 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:27.222458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:27.257141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:27.257782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:27.258059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:27.258425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:27.325391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:27.326940 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:27.336119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1314/2607] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:28.690388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:28.691843 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:28.847071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a921c-0ba9-4e61-8ceb-7693cb519dc3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:28.852985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:28.853676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:28.853995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:28.854331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:28.856150 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:28.875345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:28.880210 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:28.904025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1294/2608] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:29.002036 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:29.016918 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140836b-f127-4023-8ade-2526da17ac18 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:29.025192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:29.026189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:29.027766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:29.029381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:29.127738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:29.129391 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:29.139323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1315/2609] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:29.822921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:29.837940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd70ee-1fcd-4757-b113-818b28f10fcb service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:29.842978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49e91e-ddab-4646-8d34-edfce6d15715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:29.843636 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e91e-ddab-4646-8d34-edfce6d15715 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:29.843918 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e91e-ddab-4646-8d34-edfce6d15715 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:29.844206 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e91e-ddab-4646-8d34-edfce6d15715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:29.854933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49e91e-ddab-4646-8d34-edfce6d15715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:29.857726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49e91e-ddab-4646-8d34-edfce6d15715 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:29.869865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1295/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:33.981114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:34.102458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c9c43-9d3f-4f2c-b779-f14de0ce0667 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:34.108343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:34.109115 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:34.109454 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:34.109870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] PATH_INFO: `/v3/users/42739d5104264e78a5f55e0ce367fcd1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:34.111347 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42739d5104264e78a5f55e0ce367fcd1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:34.113362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:34.130981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:34.168736 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42739d5104264e78a5f55e0ce367fcd1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.182052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42739d5104264e78a5f55e0ce367fcd1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.189209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42739d5104264e78a5f55e0ce367fcd1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.190032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42739d5104264e78a5f55e0ce367fcd1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.190714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42739d5104264e78a5f55e0ce367fcd1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.205455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1316/2611] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:33 2022] DELETE /identity/v3/users/42739d5104264e78a5f55e0ce367fcd1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:34.210320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:34.210848 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:34.210949 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:34.232095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:34.233286 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:34.237831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:34.303156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1296/2612] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:34.313294 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:34.314990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:34.375832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679ca7e-c635-43c8-a906-3f6b547a891a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:34.379827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:34.380702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:34.380702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:34.380919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:34.391221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:34.392945 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:34.412467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1317/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:34.699637 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:34.701254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:34.713990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2b6e5-2e0a-4973-a869-83e3bedbc7cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:34.719335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:34.719989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:34.720271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:34.720544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] PATH_INFO: `/v3/projects/c007e55a889f4319974197491ef1d554` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:34.721859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c007e55a889f4319974197491ef1d554)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:34.723797 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:34.774618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c007e55a889f4319974197491ef1d554', 'request_id': 'req-560b8c53-8482-4405-9637-dd39da05d2cc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.780483 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c007e55a889f4319974197491ef1d554', 'request_id': 'req-560b8c53-8482-4405-9637-dd39da05d2cc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.789354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c007e55a889f4319974197491ef1d554', 'request_id': 'req-560b8c53-8482-4405-9637-dd39da05d2cc'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.801422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] The token cache is being invalidate because project c007e55a889f4319974197491ef1d554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:34.801746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.802502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.804144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1297/2614] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:34 2022] DELETE /identity/v3/projects/c007e55a889f4319974197491ef1d554 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:34.808297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:34.818559 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f9cdc-3292-49bb-b1ae-ff092cd6af5e service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:34.880965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:34.881632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:34.881902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:34.882172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] PATH_INFO: `/v3/users/c60c297c5f114eebbbff82e686ab0abe` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:34.883287 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60c297c5f114eebbbff82e686ab0abe)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:34.885225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:34.932049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:34.948318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60c297c5f114eebbbff82e686ab0abe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.960987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60c297c5f114eebbbff82e686ab0abe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.967909 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60c297c5f114eebbbff82e686ab0abe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.968612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60c297c5f114eebbbff82e686ab0abe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.969264 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60c297c5f114eebbbff82e686ab0abe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:34.982389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1318/2615] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:34 2022] DELETE /identity/v3/users/c60c297c5f114eebbbff82e686ab0abe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:35.353727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:35.356276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:35.380119 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b8c53-8482-4405-9637-dd39da05d2cc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:35.442432 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:35.443325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:35.443720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:35.443996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] PATH_INFO: `/v3/projects/7ac7f52e6b434969b0c2d005945f8ab5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:35.445183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac7f52e6b434969b0c2d005945f8ab5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:35.447328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:35.487558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:35.498668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac7f52e6b434969b0c2d005945f8ab5', 'request_id': 'req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.504459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac7f52e6b434969b0c2d005945f8ab5', 'request_id': 'req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.513252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac7f52e6b434969b0c2d005945f8ab5', 'request_id': 'req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.524426 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] The token cache is being invalidate because project 7ac7f52e6b434969b0c2d005945f8ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:35.524705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.525327 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.526832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1298/2616] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:35 2022] DELETE /identity/v3/projects/7ac7f52e6b434969b0c2d005945f8ab5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:35.531134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:35.532601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:35.545739 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313265a-d585-4395-884c-9a391c3f147c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:35.609747 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:35.610698 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:35.610972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:35.611239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] PATH_INFO: `/v3/users/225ad94fe2124d4998acbdc4c9d0becc` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:35.612374 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225ad94fe2124d4998acbdc4c9d0becc)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:35.614319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:35.661503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225ad94fe2124d4998acbdc4c9d0becc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.674568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225ad94fe2124d4998acbdc4c9d0becc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.682761 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225ad94fe2124d4998acbdc4c9d0becc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.683527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225ad94fe2124d4998acbdc4c9d0becc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.684251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-927912e4-47bc-4fd0-a13a-ab12828ab617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225ad94fe2124d4998acbdc4c9d0becc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:35.699397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1319/2617] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:35 2022] DELETE /identity/v3/users/225ad94fe2124d4998acbdc4c9d0becc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:36.204990 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:36.206537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:36.222558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3906f0-1d4d-44ec-8b15-81a6ed57f1ff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:36.298107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:36.298728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:36.299006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:36.299277 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] PATH_INFO: `/v3/projects/1c76468ce67d4cb8b5cc60864189e3fb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:36.300430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c76468ce67d4cb8b5cc60864189e3fb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:36.302520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:36.364593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c76468ce67d4cb8b5cc60864189e3fb', 'request_id': 'req-fe8d9d44-c85d-417a-884e-d3557b9ee260'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:36.371179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c76468ce67d4cb8b5cc60864189e3fb', 'request_id': 'req-fe8d9d44-c85d-417a-884e-d3557b9ee260'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:36.402962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c76468ce67d4cb8b5cc60864189e3fb', 'request_id': 'req-fe8d9d44-c85d-417a-884e-d3557b9ee260'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:36.421613 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] The token cache is being invalidate because project 1c76468ce67d4cb8b5cc60864189e3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:36.421994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:36.423501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe8d9d44-c85d-417a-884e-d3557b9ee260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:36.426116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1299/2618] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:36 2022] DELETE /identity/v3/projects/1c76468ce67d4cb8b5cc60864189e3fb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:36.432220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d320e-72aa-419b-b877-f90ca90e8545 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:36.432630 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d320e-72aa-419b-b877-f90ca90e8545 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:36.433427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d320e-72aa-419b-b877-f90ca90e8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:36.482535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3e6d320e-72aa-419b-b877-f90ca90e8545 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:36.483998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3e6d320e-72aa-419b-b877-f90ca90e8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:36.573091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:36.625781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1320/2619] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:36.634073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4758-7cf5-475c-bbe9-371095f6976e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:36.634661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4758-7cf5-475c-bbe9-371095f6976e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:36.635147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4758-7cf5-475c-bbe9-371095f6976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:36.662171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0a6a4758-7cf5-475c-bbe9-371095f6976e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:36.664176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0a6a4758-7cf5-475c-bbe9-371095f6976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:36.682034 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1300/2620] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:36.691686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d320e-72aa-419b-b877-f90ca90e8545 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:36.707754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d320e-72aa-419b-b877-f90ca90e8545 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:36.713872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:36.715486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:36.715733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:36.719246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:36.719246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:36.719246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:36.719246 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:36.752471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1321/2621] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:36.756706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a4758-7cf5-475c-bbe9-371095f6976e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:36.766975 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a4758-7cf5-475c-bbe9-371095f6976e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:36.772254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:36.773368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:36.773780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:36.774148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:36.776515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:36.779254 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:36.812879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1301/2622] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:36 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:36.817158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:36.828261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b098-faee-484b-a753-d19c576e1873 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:36.902686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:36.903260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:36.903537 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:36.903802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:36.904482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:36.907065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:36.946227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1322/2623] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:36 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:36.950237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:36.962743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6640d2-eee1-4ab0-a561-7a9be4b740df admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:36.970831 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:36.971725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:36.972713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:36.972713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:36.972912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:36.974552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:36.989593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1302/2624] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:36.991331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:37.008643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46612c-3832-4737-9391-3c2d7a0edc2d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:37.014878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798acddf-7ee5-461d-b93e-fdb12a1dbbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:37.015521 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798acddf-7ee5-461d-b93e-fdb12a1dbbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:37.016071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798acddf-7ee5-461d-b93e-fdb12a1dbbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:37.016190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798acddf-7ee5-461d-b93e-fdb12a1dbbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:37.016872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798acddf-7ee5-461d-b93e-fdb12a1dbbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:37.018783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798acddf-7ee5-461d-b93e-fdb12a1dbbe6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:37.034028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1323/2625] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:37.038194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:37.052469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059454-2bd3-453b-90e0-554d22d20f65 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:37.060634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:37.061566 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:37.062079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:37.062537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] PATH_INFO: `/v3/projects/e33867577aa4400c95f6698fa0fa6365/users/905ec72c1c39499792ce2b3ab5c44fc8/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:37.094638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:37.102531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33867577aa4400c95f6698fa0fa6365, user_id=905ec72c1c39499792ce2b3ab5c44fc8, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:37.113387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:37.134607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1303/2626] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:37 2022] PUT /identity/v3/projects/e33867577aa4400c95f6698fa0fa6365/users/905ec72c1c39499792ce2b3ab5c44fc8/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:37.149720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e220-7709-4069-9ddb-56f380b8fb03 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:37.150646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e220-7709-4069-9ddb-56f380b8fb03 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:37.150646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0e220-7709-4069-9ddb-56f380b8fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:37.220961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ccf0e220-7709-4069-9ddb-56f380b8fb03 None None] MFA Rules not processed for user `905ec72c1c39499792ce2b3ab5c44fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:37.222591 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ccf0e220-7709-4069-9ddb-56f380b8fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:37.325775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1324/2627] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:37.337022 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:37.338893 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:37.421089 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b089-381e-46e0-a2e6-4699e969fbb3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:37.427880 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:37.428529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:37.428813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:37.429083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:37.438262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:37.439775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:37.449320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1304/2628] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:37.791679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245056-fda2-4220-af12-bacc5c256f39 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:37.792298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245056-fda2-4220-af12-bacc5c256f39 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:37.792298 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245056-fda2-4220-af12-bacc5c256f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:37.814673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c1245056-fda2-4220-af12-bacc5c256f39 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:37.815885 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c1245056-fda2-4220-af12-bacc5c256f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:37.863672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:37.932381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1325/2629] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 30 00:43:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:37.960116 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:37.961845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:38.042929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce1de5-fda8-4903-92a9-3718e67c91c1 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:38.048495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f90fe-8894-47fc-ab84-28ae2d8b0074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:38.049188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f90fe-8894-47fc-ab84-28ae2d8b0074 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:38.049508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f90fe-8894-47fc-ab84-28ae2d8b0074 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:38.049885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f90fe-8894-47fc-ab84-28ae2d8b0074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:38.059430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f90fe-8894-47fc-ab84-28ae2d8b0074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:38.061039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f90fe-8894-47fc-ab84-28ae2d8b0074 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:38.071421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1305/2630] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:43:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:43:40.195860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245056-fda2-4220-af12-bacc5c256f39 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:40.289569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245056-fda2-4220-af12-bacc5c256f39 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:40.294800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:40.295461 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:40.295746 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:40.296016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] PATH_INFO: `/v3/users/905ec72c1c39499792ce2b3ab5c44fc8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:40.297281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=905ec72c1c39499792ce2b3ab5c44fc8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:40.299283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:40.360657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905ec72c1c39499792ce2b3ab5c44fc8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.375636 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905ec72c1c39499792ce2b3ab5c44fc8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.386779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905ec72c1c39499792ce2b3ab5c44fc8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.390583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905ec72c1c39499792ce2b3ab5c44fc8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.391617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905ec72c1c39499792ce2b3ab5c44fc8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.407861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1326/2631] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:40 2022] DELETE /identity/v3/users/905ec72c1c39499792ce2b3ab5c44fc8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:40.412776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:40.413262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:40.413390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:40.439390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:40.440798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:40.508108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1306/2632] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:40.518765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:40.520290 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:40.622235 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:40.623816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:40.637900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02749c18-3815-4c19-85c7-7d5b4f1cacab None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:40.643221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:40.644040 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:40.644385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:40.644721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] PATH_INFO: `/v3/users/39828766c08c41558372cbec64877443` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:40.646073 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39828766c08c41558372cbec64877443)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:40.648329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:40.673735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:40.718965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39828766c08c41558372cbec64877443'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.719734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39828766c08c41558372cbec64877443'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.728549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39828766c08c41558372cbec64877443'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.729161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de572add-09ea-4a86-89a5-3ae30889d23b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:40.734132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d21385-4acb-46f0-b8c8-4e38fe17edd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:40.734809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d21385-4acb-46f0-b8c8-4e38fe17edd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:40.735145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d21385-4acb-46f0-b8c8-4e38fe17edd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:40.735729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d21385-4acb-46f0-b8c8-4e38fe17edd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:40.739463 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39828766c08c41558372cbec64877443'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.740205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39828766c08c41558372cbec64877443'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:40.745730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d21385-4acb-46f0-b8c8-4e38fe17edd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:40.747149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d21385-4acb-46f0-b8c8-4e38fe17edd0 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:40.751119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:40.758868 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1327/2633] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:40.763667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1307/2634] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:40 2022] DELETE /identity/v3/users/39828766c08c41558372cbec64877443 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:40.768149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:40.768622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:40.769004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:40.790669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:40.791908 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:40.865977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1328/2635] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:40.886900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:40.888930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:40.981031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eb044-5ee6-4bc6-bf4b-7b69b56975a4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:40.984896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995cf9e-8095-4544-bad6-4b46211ede93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:40.985932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cf9e-8095-4544-bad6-4b46211ede93 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:40.986290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cf9e-8095-4544-bad6-4b46211ede93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:40.986630 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995cf9e-8095-4544-bad6-4b46211ede93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:40.996665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995cf9e-8095-4544-bad6-4b46211ede93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:40.998287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995cf9e-8095-4544-bad6-4b46211ede93 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:41.009929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1308/2636] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:41.125628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:41.127288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:41.186650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cc9a-8f5d-4cbe-a31a-33ee1015d1b4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:41.196615 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:41.197242 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.197488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.197774 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] PATH_INFO: `/v3/projects/e33867577aa4400c95f6698fa0fa6365` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.199114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33867577aa4400c95f6698fa0fa6365)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:41.202349 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:41.279730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33867577aa4400c95f6698fa0fa6365', 'request_id': 'req-3a161e9d-4bbd-4b90-8d25-181e30f78722'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.288197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33867577aa4400c95f6698fa0fa6365', 'request_id': 'req-3a161e9d-4bbd-4b90-8d25-181e30f78722'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.308775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33867577aa4400c95f6698fa0fa6365', 'request_id': 'req-3a161e9d-4bbd-4b90-8d25-181e30f78722'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.339059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] The token cache is being invalidate because project e33867577aa4400c95f6698fa0fa6365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:41.340273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.347184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3a161e9d-4bbd-4b90-8d25-181e30f78722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.349766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1329/2637] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:41 2022] DELETE /identity/v3/projects/e33867577aa4400c95f6698fa0fa6365 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:41.355441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29aa0-2343-4458-93a8-e99c9756029a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.355764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29aa0-2343-4458-93a8-e99c9756029a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.356029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac29aa0-2343-4458-93a8-e99c9756029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.406534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aac29aa0-2343-4458-93a8-e99c9756029a None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:41.407968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aac29aa0-2343-4458-93a8-e99c9756029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:41.488368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1309/2638] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:41.497709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769311c9-a9f1-4a33-b4f9-e83045d6f7a1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.498321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769311c9-a9f1-4a33-b4f9-e83045d6f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.498928 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769311c9-a9f1-4a33-b4f9-e83045d6f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.523313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-769311c9-a9f1-4a33-b4f9-e83045d6f7a1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:41.524563 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-769311c9-a9f1-4a33-b4f9-e83045d6f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:41.536074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1330/2639] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:41.541943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac29aa0-2343-4458-93a8-e99c9756029a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:41.555259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac29aa0-2343-4458-93a8-e99c9756029a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:41.563890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:41.564889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.566041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.566489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.568465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:41.568976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:41.570795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:41.593320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1310/2640] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:41.594446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769311c9-a9f1-4a33-b4f9-e83045d6f7a1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:41.604728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769311c9-a9f1-4a33-b4f9-e83045d6f7a1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:41.606722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:41.610088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:41.610917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:41.611992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.612598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.612989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.613846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:41.616350 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:41.630029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037ea3c-9563-41c9-ba8b-c054e3534af6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:41.640284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:41.641168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.641582 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.642028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] PATH_INFO: `/v3/projects/9f573e5937db4e21a61dc78721e4304e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.643626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f573e5937db4e21a61dc78721e4304e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:41.646174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:41.653837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1331/2641] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:41 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:41.659241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:41.679067 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:41.726159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f573e5937db4e21a61dc78721e4304e', 'request_id': 'req-83593769-18a6-4708-a31f-ea1087e39179'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.737328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f573e5937db4e21a61dc78721e4304e', 'request_id': 'req-83593769-18a6-4708-a31f-ea1087e39179'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.749773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f573e5937db4e21a61dc78721e4304e', 'request_id': 'req-83593769-18a6-4708-a31f-ea1087e39179'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.754800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:41.777818 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2c3c2-937c-4874-8e61-5e9450fef335 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:41.788184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] The token cache is being invalidate because project 9f573e5937db4e21a61dc78721e4304e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:41.789752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.792751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:41.795971 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1311/2642] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:41 2022] DELETE /identity/v3/projects/9f573e5937db4e21a61dc78721e4304e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:41.802114 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:41.803268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:41.901053 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:41.901857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.902315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.902595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.904452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:41.907346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:41.908828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83593769-18a6-4708-a31f-ea1087e39179 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:41.919755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:41.920647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.921024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.921604 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] PATH_INFO: `/v3/users/514a5055a1ef40adbe469affc1352785` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.923689 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=514a5055a1ef40adbe469affc1352785)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:41.925889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:41.954169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1332/2643] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:41 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:41.955529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:41.960956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:41.986486 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140c892-d680-4765-ab90-2e2849578d53 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:41.993640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:41.993836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:41.994547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:41.994547 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:41.995241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:41.996973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:42.011823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1333/2644] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:42.011979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514a5055a1ef40adbe469affc1352785'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.011979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514a5055a1ef40adbe469affc1352785'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.012917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:42.020659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514a5055a1ef40adbe469affc1352785'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.031826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456eb06-6332-4271-8090-2b2717356c83 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:42.033059 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514a5055a1ef40adbe469affc1352785'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.034177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-bb694a03-bbe4-4678-a4bd-a908c5657f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514a5055a1ef40adbe469affc1352785'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.048678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:42.049312 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.050161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.050161 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.050528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:42.052353 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:42.067992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1334/2645] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:42.071986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:42.074096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.076241 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1312/2646] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:41 2022] DELETE /identity/v3/users/514a5055a1ef40adbe469affc1352785 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:42.106508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e161f-8aef-4e07-bcda-cea309b34777 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:42.184369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:42.185220 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.185604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.185952 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] PATH_INFO: `/v3/projects/2518a9bf358d4a9488d955fe464b98f5/users/7e2b0bca33664abc8cc4c19f08402d9a/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.200509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2518a9bf358d4a9488d955fe464b98f5, user_id=7e2b0bca33664abc8cc4c19f08402d9a, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:42.203854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:42.218308 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1335/2647] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:42 2022] PUT /identity/v3/projects/2518a9bf358d4a9488d955fe464b98f5/users/7e2b0bca33664abc8cc4c19f08402d9a/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:42.228287 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.228553 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.228827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.262233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] MFA Rules not processed for user `7e2b0bca33664abc8cc4c19f08402d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:42.263528 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.279020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:42.370933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1313/2648] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:42.382870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:42.386114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.473694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049899b-d769-4d9a-a4fc-c3b1036326ab admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:42.481827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:42.483206 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.483992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.484542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.493066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:42.498862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:42.511426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:42.536057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1336/2649] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:42.566828 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:42.569137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.590663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:42.596466 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.660586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a089c-211d-47e2-af01-ba7f09d71583 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:42.666967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:42.667995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.668587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.669054 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] PATH_INFO: `/v3/projects/d369902e7de74e4399c35e90125e6809` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.670455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d369902e7de74e4399c35e90125e6809)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:42.673450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:42.701468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093e1e4-f816-4b04-9e87-9adcb685b648 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:42.707389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8f498-3acc-4390-ac66-ca93d69f7d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:42.708050 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f498-3acc-4390-ac66-ca93d69f7d09 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.708328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f498-3acc-4390-ac66-ca93d69f7d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.708586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f498-3acc-4390-ac66-ca93d69f7d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.712722 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bae8f498-3acc-4390-ac66-ca93d69f7d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.726620 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8f498-3acc-4390-ac66-ca93d69f7d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:42.728562 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8f498-3acc-4390-ac66-ca93d69f7d09 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:42.741468 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1337/2650] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:42.746389 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd369902e7de74e4399c35e90125e6809', 'request_id': 'req-921634a6-508c-4956-b449-fadba244ed14'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.755230 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd369902e7de74e4399c35e90125e6809', 'request_id': 'req-921634a6-508c-4956-b449-fadba244ed14'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.772857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd369902e7de74e4399c35e90125e6809', 'request_id': 'req-921634a6-508c-4956-b449-fadba244ed14'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.793113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] The token cache is being invalidate because project d369902e7de74e4399c35e90125e6809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:42.793652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.794867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-921634a6-508c-4956-b449-fadba244ed14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:42.797688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1314/2651] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:42 2022] DELETE /identity/v3/projects/d369902e7de74e4399c35e90125e6809 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:42.803128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9373cb-b35a-443e-953d-5a7f6ec10ebe None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.803413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9373cb-b35a-443e-953d-5a7f6ec10ebe None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.803683 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9373cb-b35a-443e-953d-5a7f6ec10ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.831155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ed9373cb-b35a-443e-953d-5a7f6ec10ebe None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:42.832632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ed9373cb-b35a-443e-953d-5a7f6ec10ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.925484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1338/2652] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:42.933181 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c40bc1-5b58-477e-8af5-68bd87da2640 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.933610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c40bc1-5b58-477e-8af5-68bd87da2640 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.934015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c40bc1-5b58-477e-8af5-68bd87da2640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.963118 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-44c40bc1-5b58-477e-8af5-68bd87da2640 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:42.964498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-44c40bc1-5b58-477e-8af5-68bd87da2640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:42.973239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1315/2653] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:42.977902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9373cb-b35a-443e-953d-5a7f6ec10ebe None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:42.990484 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9373cb-b35a-443e-953d-5a7f6ec10ebe None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:42.995419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:42.996030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:42.996303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:42.996564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:42.997212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:42.997655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:42.999498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.019598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1339/2654] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:43.020109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c40bc1-5b58-477e-8af5-68bd87da2640 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.030358 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c40bc1-5b58-477e-8af5-68bd87da2640 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.035733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.036467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.036847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.037213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.038634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.040676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.078341 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1316/2655] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:43 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:43.079602 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.103574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e48aa-5136-4c07-a5de-9917fdeef122 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.182364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.182896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.183502 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.183786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.184423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.186377 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.217759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1340/2656] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:43 2022] POST /identity/v3/users => generated 305 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:43.219249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.230925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b2f85-a877-427f-974a-9f64a5fc2779 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.236660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.237281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.237642 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.237868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.238503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.240281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.251706 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1317/2657] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:43.255730 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.267577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddd6fd-e051-4695-b9c9-a4482b3b30cf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.272936 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdcdd3-125c-4c44-8aae-8ce335532d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.273776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcdd3-125c-4c44-8aae-8ce335532d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.274053 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcdd3-125c-4c44-8aae-8ce335532d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.274323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcdd3-125c-4c44-8aae-8ce335532d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.274969 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdcdd3-125c-4c44-8aae-8ce335532d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.276574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdcdd3-125c-4c44-8aae-8ce335532d2b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.287906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1341/2658] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:43.292321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.303576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121483ab-c2b8-4cc8-8aee-987bc84f4d0a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.308578 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.311121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.311121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.311121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] PATH_INFO: `/v3/projects/be0393fa316740c383f811747d9d7946/users/a464db008aaf4b5ba423e6e82314db94/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.313392 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:43.328262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0393fa316740c383f811747d9d7946, user_id=a464db008aaf4b5ba423e6e82314db94, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.331878 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.350517 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1318/2659] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:43 2022] PUT /identity/v3/projects/be0393fa316740c383f811747d9d7946/users/a464db008aaf4b5ba423e6e82314db94/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:43.361560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2399ba-2ae7-4cd5-924e-a08788fe5036 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.362146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2399ba-2ae7-4cd5-924e-a08788fe5036 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.362574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2399ba-2ae7-4cd5-924e-a08788fe5036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.370076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:43.408430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.410366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:43.416426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ce2399ba-2ae7-4cd5-924e-a08788fe5036 None None] MFA Rules not processed for user `a464db008aaf4b5ba423e6e82314db94`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:43.418134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ce2399ba-2ae7-4cd5-924e-a08788fe5036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:43.486111 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e5f6-ae3f-400a-9502-2c39addcc501 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.491456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.492275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.492708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.493144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] PATH_INFO: `/v3/users/9b09fd3571d047819489f393c847103c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.494546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b09fd3571d047819489f393c847103c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.498225 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.503120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1342/2660] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:43 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:43.507743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2399ba-2ae7-4cd5-924e-a08788fe5036 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.521661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2399ba-2ae7-4cd5-924e-a08788fe5036 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.528934 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.529894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.530346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.530825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.531606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.533728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.569470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b09fd3571d047819489f393c847103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:43.570283 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b09fd3571d047819489f393c847103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:43.578205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1343/2661] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:43 2022] POST /identity/v3/projects => generated 407 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:43.581086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b09fd3571d047819489f393c847103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:43.581880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.593453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b09fd3571d047819489f393c847103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:43.594704 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a0a095c-2d56-4b68-8ac7-0d8d1b89762f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b09fd3571d047819489f393c847103c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:43.623563 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1319/2662] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:43 2022] DELETE /identity/v3/users/9b09fd3571d047819489f393c847103c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:43.628207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.629193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.629435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.654153 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:43.655821 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:43.668149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b5533-cc30-4ca5-923f-78a7bfe20d25 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.766795 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1320/2663] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:43.774812 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.777106 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.777653 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.778154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.779071 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.781441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.795439 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.797297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:43.803506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:43.834948 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1344/2664] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:43 2022] POST /identity/v3/users => generated 310 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:43.842218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.844416 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:43.861188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7aabe-6691-43bc-8910-d1c22eab0952 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.888802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.891550 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.892093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.892575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.894650 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.897066 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.899109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:43.925731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1265-6ea4-4828-b6d8-867868bd93dd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.934137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1345/2665] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:43.935505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:43.942061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.942802 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.943032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.943301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.955373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642b5d1-c5ec-441a-89c3-dc38d73ab45e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:43.962339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:43.962771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.963446 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:43.963874 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:43.964285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] PATH_INFO: `/v3/projects/a75dce2558ee404191b7a0f5b7266a84/users/7a1bdd90a56647faa8151bbf606ffec2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:43.964506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:43.976296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1321/2666] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:43.982987 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75dce2558ee404191b7a0f5b7266a84, user_id=7a1bdd90a56647faa8151bbf606ffec2, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:43.986080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:44.007635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1346/2667] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:43 2022] PUT /identity/v3/projects/a75dce2558ee404191b7a0f5b7266a84/users/7a1bdd90a56647faa8151bbf606ffec2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:44.009003 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:44.020755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25196e-a555-4771-998f-f0f6f8f6a89d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:44.098293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d95e30-2115-4657-9292-493b538e81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:44.098983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d95e30-2115-4657-9292-493b538e81b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:44.099321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d95e30-2115-4657-9292-493b538e81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:44.100214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d95e30-2115-4657-9292-493b538e81b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:44.100876 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d95e30-2115-4657-9292-493b538e81b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:44.103692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d95e30-2115-4657-9292-493b538e81b1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:44.124307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1322/2668] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:44.125368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:44.136912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cde4cb-a7af-4f16-a291-16cb25273355 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:44.143896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:44.144627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:44.144949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:44.145218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] PATH_INFO: `/v3/projects/a75dce2558ee404191b7a0f5b7266a84/users/7a1bdd90a56647faa8151bbf606ffec2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:44.147949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75dce2558ee404191b7a0f5b7266a84, user_id=7a1bdd90a56647faa8151bbf606ffec2, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:44.150724 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:44.164172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1347/2669] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:44 2022] PUT /identity/v3/projects/a75dce2558ee404191b7a0f5b7266a84/users/7a1bdd90a56647faa8151bbf606ffec2/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:44.175473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:44.175800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:44.177623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:44.212388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] MFA Rules not processed for user `7a1bdd90a56647faa8151bbf606ffec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:44.213914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:44.310488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1323/2670] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:44 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:44.322444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:44.324475 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:44.413930 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485289-9622-4550-bb0b-3166cdffb928 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:44.422764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:44.423482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:44.423825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:44.424158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:44.446058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:44.447787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:44.480635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1348/2671] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:44 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:44.716493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:44.718491 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:44.734968 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c08692-4a6e-47c4-bc5b-dca5b60e7ec5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:44.740304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:44.741474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:44.741951 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:44.742398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:44.744663 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:44.750102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:44.752412 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:44.821017 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:44.877693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a386-5dd6-4450-9027-64dd429348b4 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:44.882601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:44.883625 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:44.884190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:44.884470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] PATH_INFO: `/v3/projects/7423b039f97941dabc8472a6ee2dcfa9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:44.885799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7423b039f97941dabc8472a6ee2dcfa9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:44.887700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:44.906189 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:44.908974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:44.931179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1324/2672] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:44 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:44.981401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7423b039f97941dabc8472a6ee2dcfa9', 'request_id': 'req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:44.999533 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7423b039f97941dabc8472a6ee2dcfa9', 'request_id': 'req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:45.015481 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7423b039f97941dabc8472a6ee2dcfa9', 'request_id': 'req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:45.018280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:45.043107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] The token cache is being invalidate because project 7423b039f97941dabc8472a6ee2dcfa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:45.043517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:45.044765 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:45.061493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1349/2673] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:44 2022] DELETE /identity/v3/projects/7423b039f97941dabc8472a6ee2dcfa9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:46.936005 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:46.939725 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:46.971112 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a800-0333-44ff-835b-e1b062e359a7 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:47.062502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:47.063081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:47.063356 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:47.063635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] PATH_INFO: `/v3/users/dda5f49a1f49429f882ecbf6911a483e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:47.064895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda5f49a1f49429f882ecbf6911a483e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:47.067163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:47.154296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda5f49a1f49429f882ecbf6911a483e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.155268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda5f49a1f49429f882ecbf6911a483e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.165618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda5f49a1f49429f882ecbf6911a483e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.175593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda5f49a1f49429f882ecbf6911a483e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.176238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda5f49a1f49429f882ecbf6911a483e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.212749 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1325/2674] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:46 2022] DELETE /identity/v3/users/dda5f49a1f49429f882ecbf6911a483e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:47.412398 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:47.414093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:47.430379 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ef9d-d34f-46e2-b5f8-35bf9f6d5866 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:47.503023 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:47.503413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:47.503686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:47.503950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] PATH_INFO: `/v3/projects/3361709f899a4f99a88e3e694e0e4737` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:47.505166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3361709f899a4f99a88e3e694e0e4737)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:47.507122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:47.556822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3361709f899a4f99a88e3e694e0e4737', 'request_id': 'req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.563528 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3361709f899a4f99a88e3e694e0e4737', 'request_id': 'req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.573994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3361709f899a4f99a88e3e694e0e4737', 'request_id': 'req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.594463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] The token cache is being invalidate because project 3361709f899a4f99a88e3e694e0e4737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:47.594923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.595861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.597631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1350/2675] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:47 2022] DELETE /identity/v3/projects/3361709f899a4f99a88e3e694e0e4737 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:47.602787 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:47.604355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:47.609516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:47.611548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:47.619435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08949c-ff89-46f5-9d81-b341c8eb13d7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:47.666986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:47.689307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a8e91-a68f-4dbb-9a6a-d5dabae402fb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:47.691402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:47.692109 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:47.692384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:47.692647 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] PATH_INFO: `/v3/users/316ad3bd299e4e6c9ce51b1bf6073dff` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:47.693640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:47.693783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] RBAC: Authorizing `identity:delete_user(user_id=316ad3bd299e4e6c9ce51b1bf6073dff)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:47.694395 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:47.694742 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:47.695076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] PATH_INFO: `/v3/users/2532defc863d4fbe8885c6f38169b5c8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:47.695970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:47.696328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2532defc863d4fbe8885c6f38169b5c8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:47.698436 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:47.726121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:47.754993 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316ad3bd299e4e6c9ce51b1bf6073dff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.755739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316ad3bd299e4e6c9ce51b1bf6073dff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.758149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2532defc863d4fbe8885c6f38169b5c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.763228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316ad3bd299e4e6c9ce51b1bf6073dff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.772835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2532defc863d4fbe8885c6f38169b5c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.774176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316ad3bd299e4e6c9ce51b1bf6073dff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.774805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316ad3bd299e4e6c9ce51b1bf6073dff'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.780535 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2532defc863d4fbe8885c6f38169b5c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.781252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2532defc863d4fbe8885c6f38169b5c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.781911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2532defc863d4fbe8885c6f38169b5c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:47.794430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1326/2676] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:47 2022] DELETE /identity/v3/users/316ad3bd299e4e6c9ce51b1bf6073dff => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:47.802367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1351/2677] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:47 2022] DELETE /identity/v3/users/2532defc863d4fbe8885c6f38169b5c8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:48.017842 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.019841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.025247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.027145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.115925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29885-45e2-496e-8247-1fffc668fd5d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.121059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.122146 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.123307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.123608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] PATH_INFO: `/v3/projects/3e18dbec9ee44c84ac4a19667d91b336` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.125323 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e18dbec9ee44c84ac4a19667d91b336)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.127582 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.140161 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56425053-e7cb-4fbb-a5da-a84134c4748e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.144826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.145473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.145762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.146035 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] PATH_INFO: `/v3/projects/3da0b589db1a4f748f472693ef9041a0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.147385 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da0b589db1a4f748f472693ef9041a0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.150468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.182504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e18dbec9ee44c84ac4a19667d91b336', 'request_id': 'req-24220aea-2784-448e-9ced-1608cc6bdb83'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.190711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e18dbec9ee44c84ac4a19667d91b336', 'request_id': 'req-24220aea-2784-448e-9ced-1608cc6bdb83'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.197606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e18dbec9ee44c84ac4a19667d91b336', 'request_id': 'req-24220aea-2784-448e-9ced-1608cc6bdb83'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.207699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da0b589db1a4f748f472693ef9041a0', 'request_id': 'req-426094ef-749b-4b88-945d-87641e672991'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.212380 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] The token cache is being invalidate because project 3e18dbec9ee44c84ac4a19667d91b336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:48.212784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.213346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.213799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da0b589db1a4f748f472693ef9041a0', 'request_id': 'req-426094ef-749b-4b88-945d-87641e672991'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.215182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1352/2678] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:48 2022] DELETE /identity/v3/projects/3e18dbec9ee44c84ac4a19667d91b336 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:48.216006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.217284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.222826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da0b589db1a4f748f472693ef9041a0', 'request_id': 'req-426094ef-749b-4b88-945d-87641e672991'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.224080 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:48.240662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] The token cache is being invalidate because project 3da0b589db1a4f748f472693ef9041a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:48.240889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.241533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-426094ef-749b-4b88-945d-87641e672991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.243477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1327/2679] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:48 2022] DELETE /identity/v3/projects/3da0b589db1a4f748f472693ef9041a0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:48.248362 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b30cff-19d8-411d-9c32-e25c4a499d2d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.248645 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b30cff-19d8-411d-9c32-e25c4a499d2d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.249029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b30cff-19d8-411d-9c32-e25c4a499d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.252797 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:48.275867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c3b30cff-19d8-411d-9c32-e25c4a499d2d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:48.277315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c3b30cff-19d8-411d-9c32-e25c4a499d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.295590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220aea-2784-448e-9ced-1608cc6bdb83 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.354470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1328/2680] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:48.354470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa1f3-fd98-440b-be1d-4a8cf30465ad None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.354470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa1f3-fd98-440b-be1d-4a8cf30465ad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.354470 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aa1f3-fd98-440b-be1d-4a8cf30465ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.367028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.368026 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.368303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.368661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] PATH_INFO: `/v3/users/7e2b0bca33664abc8cc4c19f08402d9a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.369870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2b0bca33664abc8cc4c19f08402d9a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.371830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.372411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-506aa1f3-fd98-440b-be1d-4a8cf30465ad None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:48.373646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-506aa1f3-fd98-440b-be1d-4a8cf30465ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.390099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1329/2681] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:48.391580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245692f-18ab-426d-9296-e21b45fba7f5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.391862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245692f-18ab-426d-9296-e21b45fba7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.392135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245692f-18ab-426d-9296-e21b45fba7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.416205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1245692f-18ab-426d-9296-e21b45fba7f5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:48.417402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1245692f-18ab-426d-9296-e21b45fba7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.425652 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1330/2682] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:48.426826 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127862-dd08-4a39-a52e-50d1f85f5a82 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.427165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127862-dd08-4a39-a52e-50d1f85f5a82 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.427370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127862-dd08-4a39-a52e-50d1f85f5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.437925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2b0bca33664abc8cc4c19f08402d9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.447601 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-83127862-dd08-4a39-a52e-50d1f85f5a82 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:48.448805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-83127862-dd08-4a39-a52e-50d1f85f5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.450644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2b0bca33664abc8cc4c19f08402d9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.456829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1331/2683] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:48.457765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83127862-dd08-4a39-a52e-50d1f85f5a82 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.461107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2b0bca33664abc8cc4c19f08402d9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.461872 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2b0bca33664abc8cc4c19f08402d9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.462539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2b0bca33664abc8cc4c19f08402d9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:48.467323 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83127862-dd08-4a39-a52e-50d1f85f5a82 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.472890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6cced-6884-4cb0-9b76-e9a9b32a5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.473494 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6cced-6884-4cb0-9b76-e9a9b32a5a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.473803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6cced-6884-4cb0-9b76-e9a9b32a5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.474075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6cced-6884-4cb0-9b76-e9a9b32a5a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.474728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6cced-6884-4cb0-9b76-e9a9b32a5a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:48.475057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6cced-6884-4cb0-9b76-e9a9b32a5a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.476646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6cced-6884-4cb0-9b76-e9a9b32a5a0d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.480319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1353/2684] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:48 2022] DELETE /identity/v3/users/7e2b0bca33664abc8cc4c19f08402d9a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:48.480983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.482401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.490370 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1332/2685] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:48.491815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bbf3-8f52-4132-af0a-c06e5140e6a0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.492217 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bbf3-8f52-4132-af0a-c06e5140e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.492587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bbf3-8f52-4132-af0a-c06e5140e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.512514 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-21e9bbf3-8f52-4132-af0a-c06e5140e6a0 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:48.513932 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-21e9bbf3-8f52-4132-af0a-c06e5140e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.546973 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:48.551114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c9d9-04a8-4f65-9dfd-468eb42d3734 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.557758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.558487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.559093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.559378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.560031 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:48.560337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.562337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.574554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1354/2686] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:48.575356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.575991 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1333/2687] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:48.579899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9bbf3-8f52-4132-af0a-c06e5140e6a0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.581815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.590156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9bbf3-8f52-4132-af0a-c06e5140e6a0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.595233 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.595477 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052ad35-2ef9-4d5b-b78d-f8de13e3394c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.595974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.596440 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.596874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.597618 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.599930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.602331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.603011 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.603321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.603595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.604267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.606188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.640884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1355/2688] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:48.641825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.645767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1334/2689] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:48.645767 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.646838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.689198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:48.704112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d8734-e264-43bd-8898-781e6f69c652 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.711664 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb687dd-0593-4b5f-887b-7203004a7d34 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.718209 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.718824 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.719100 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.719371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.720004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.722113 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.748293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1335/2690] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:43:48.748293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.755056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.755644 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.755922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.756069 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b409d9-bb46-41c3-a462-d452534a0ebb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.756223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.760830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.761464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.761743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.762129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.762640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.764552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.765638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.767214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.777376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1356/2691] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:48.778241 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.787590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8939c2-75df-4b80-859b-c6116f543d52 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.791743 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1336/2692] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:48.792872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.795253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.795848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.796268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.796542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.797177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.798779 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.805122 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d25cdd-c354-40e8-84ea-c98ed0704f37 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.809704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1357/2693] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:48.814002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.814347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.815155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.815429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.815857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.816377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.818098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.825686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf348f4-cb03-450f-b74d-bf0ca1fa6ee9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.834715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1337/2694] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:48.834922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.834922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.834922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.834922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.835319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.835428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.836085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.846360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe16db-9a70-47ae-8b60-880bcd624196 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.847680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1358/2695] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:48.851627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.855424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.856419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.856919 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.857720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.859087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.861602 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.862378 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a4449-e947-47d6-b66c-961330294d87 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.870197 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa04d-4c33-4853-a8d9-6b7a8e85f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.870857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa04d-4c33-4853-a8d9-6b7a8e85f140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.871134 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa04d-4c33-4853-a8d9-6b7a8e85f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.871407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa04d-4c33-4853-a8d9-6b7a8e85f140 admin admin] PATH_INFO: `/v3/projects/cdf9c319862348bcb932f57da4749cd1/users/5121b4edd870476a8082e4f5787a52ee/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.875970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1338/2696] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:48.879914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:48.888700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa04d-4c33-4853-a8d9-6b7a8e85f140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf9c319862348bcb932f57da4749cd1, user_id=5121b4edd870476a8082e4f5787a52ee, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.890936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ea0f1-60df-4f64-a9f2-309915be3b85 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:48.891530 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa04d-4c33-4853-a8d9-6b7a8e85f140 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.895640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30da7-8aa1-4a2f-a965-ccd97e0ea9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:48.896441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30da7-8aa1-4a2f-a965-ccd97e0ea9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.896914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30da7-8aa1-4a2f-a965-ccd97e0ea9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.897198 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30da7-8aa1-4a2f-a965-ccd97e0ea9eb admin admin] PATH_INFO: `/v3/projects/b0ebf3f5c657416abe56baa0a47edbb6/users/b54d890032874c65a74a63d4113dc5fe/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.915396 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1359/2697] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:48 2022] PUT /identity/v3/projects/cdf9c319862348bcb932f57da4749cd1/users/5121b4edd870476a8082e4f5787a52ee/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:48.920548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bdcf-f943-4626-8459-3fd6ed1aae0d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.920841 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bdcf-f943-4626-8459-3fd6ed1aae0d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.921144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bdcf-f943-4626-8459-3fd6ed1aae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.922775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30da7-8aa1-4a2f-a965-ccd97e0ea9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ebf3f5c657416abe56baa0a47edbb6, user_id=b54d890032874c65a74a63d4113dc5fe, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:48.925518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30da7-8aa1-4a2f-a965-ccd97e0ea9eb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:48.943059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e114bdcf-f943-4626-8459-3fd6ed1aae0d None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:48.943694 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1339/2698] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:48 2022] PUT /identity/v3/projects/b0ebf3f5c657416abe56baa0a47edbb6/users/b54d890032874c65a74a63d4113dc5fe/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:48.944304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e114bdcf-f943-4626-8459-3fd6ed1aae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:48.953201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:48.953485 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:48.954221 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:48.987184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:48.993177 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] MFA Rules not processed for user `b54d890032874c65a74a63d4113dc5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:48.994727 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:49.016977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1360/2699] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:43:49.027640 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114bdcf-f943-4626-8459-3fd6ed1aae0d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:49.080355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1340/2700] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:49.092752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:49.094896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:49.096691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114bdcf-f943-4626-8459-3fd6ed1aae0d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:49.102729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:49.103642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:49.103642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:49.103866 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:49.114545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:49.117618 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:49.130622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1361/2701] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:49.131457 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:49.133303 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:49.149900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53b489-09d6-45ae-b8f0-c557ae18c54a service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:49.155915 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:49.156577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:49.157003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:49.157240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] PATH_INFO: `/v3/projects/2518a9bf358d4a9488d955fe464b98f5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:49.158616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2518a9bf358d4a9488d955fe464b98f5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:49.160754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:49.165369 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f5494-dab2-4fdc-8e79-b65ea24a0f18 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:49.170398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:49.171081 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:49.171532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:49.171861 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:49.180782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:49.182383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:49.186160 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:49.194546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1341/2702] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:49.221707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2518a9bf358d4a9488d955fe464b98f5', 'request_id': 'req-ce56f72c-9386-41bf-b14b-6db9b343d460'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:49.230947 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2518a9bf358d4a9488d955fe464b98f5', 'request_id': 'req-ce56f72c-9386-41bf-b14b-6db9b343d460'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:49.239955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2518a9bf358d4a9488d955fe464b98f5', 'request_id': 'req-ce56f72c-9386-41bf-b14b-6db9b343d460'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:49.255319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] The token cache is being invalidate because project 2518a9bf358d4a9488d955fe464b98f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:49.255612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:49.256439 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce56f72c-9386-41bf-b14b-6db9b343d460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:49.258107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1362/2703] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:49 2022] DELETE /identity/v3/projects/2518a9bf358d4a9488d955fe464b98f5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:50.913792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:50.916333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:50.935174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98cc21-66a9-4852-b163-adb476de0a78 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:51.035529 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:51.036740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:51.036740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:51.036965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] PATH_INFO: `/v3/users/a464db008aaf4b5ba423e6e82314db94` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:51.038075 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a464db008aaf4b5ba423e6e82314db94)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:51.040117 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:51.116007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a464db008aaf4b5ba423e6e82314db94'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.116870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a464db008aaf4b5ba423e6e82314db94'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.129320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a464db008aaf4b5ba423e6e82314db94'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.136512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a464db008aaf4b5ba423e6e82314db94'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.137342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a464db008aaf4b5ba423e6e82314db94'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.173016 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1342/2704] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:50 2022] DELETE /identity/v3/users/a464db008aaf4b5ba423e6e82314db94 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:51.174966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:51.175564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:51.175564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:51.207981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:51.209514 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:51.276506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1363/2705] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:51.286347 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:51.287914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:51.347515 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8eac-7748-4568-837d-fb1c05509b1a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:51.351809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:51.352540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:51.352889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:51.353220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:51.364408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:51.365976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:51.382576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1343/2706] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:43:51.703027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:51.704611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:51.730682 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518874dd-ae3c-4ba1-896d-3fb3b9f3845c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:51.741052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:51.741857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:51.742234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:51.742593 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] PATH_INFO: `/v3/projects/be0393fa316740c383f811747d9d7946` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:51.745081 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0393fa316740c383f811747d9d7946)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:51.747159 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:51.753827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:51.823028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0393fa316740c383f811747d9d7946', 'request_id': 'req-80130064-9f55-40ea-b152-faa614404085'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.830470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0393fa316740c383f811747d9d7946', 'request_id': 'req-80130064-9f55-40ea-b152-faa614404085'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.837731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0393fa316740c383f811747d9d7946', 'request_id': 'req-80130064-9f55-40ea-b152-faa614404085'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.874839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] The token cache is being invalidate because project be0393fa316740c383f811747d9d7946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:51.875104 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.875611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:51.878207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1364/2707] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:51 2022] DELETE /identity/v3/projects/be0393fa316740c383f811747d9d7946 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:51.882330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:51.895098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fc44f-93e9-4db2-94be-5fcc266e13f5 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:51.925481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:51.992644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:51.993467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:51.993860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:51.994220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] PATH_INFO: `/v3/users/7a1bdd90a56647faa8151bbf606ffec2` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:51.995469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1bdd90a56647faa8151bbf606ffec2)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:51.999388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:52.062962 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1bdd90a56647faa8151bbf606ffec2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.063870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1bdd90a56647faa8151bbf606ffec2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.075058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1bdd90a56647faa8151bbf606ffec2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.088093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1bdd90a56647faa8151bbf606ffec2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.094495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fe9c7bc-b318-4c46-b237-191594cc87f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1bdd90a56647faa8151bbf606ffec2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.130760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1344/2708] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:51 2022] DELETE /identity/v3/users/7a1bdd90a56647faa8151bbf606ffec2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:52.546986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:52.551384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:52.584225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80130064-9f55-40ea-b152-faa614404085 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:52.688531 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:52.689740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:52.691014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:52.691509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] PATH_INFO: `/v3/projects/a75dce2558ee404191b7a0f5b7266a84` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:52.694236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75dce2558ee404191b7a0f5b7266a84)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:52.697384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:52.816852 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75dce2558ee404191b7a0f5b7266a84', 'request_id': 'req-aba37f40-afda-4230-a29f-9442d706e992'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.836721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75dce2558ee404191b7a0f5b7266a84', 'request_id': 'req-aba37f40-afda-4230-a29f-9442d706e992'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.863339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75dce2558ee404191b7a0f5b7266a84', 'request_id': 'req-aba37f40-afda-4230-a29f-9442d706e992'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.882743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] The token cache is being invalidate because project a75dce2558ee404191b7a0f5b7266a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:43:52.883489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.885871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-aba37f40-afda-4230-a29f-9442d706e992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:52.888190 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1365/2709] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:43:52 2022] DELETE /identity/v3/projects/a75dce2558ee404191b7a0f5b7266a84 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:52.893110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20cca-b548-4e57-91c7-a3a2f2aa9ec2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:52.893382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20cca-b548-4e57-91c7-a3a2f2aa9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:52.893781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20cca-b548-4e57-91c7-a3a2f2aa9ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:52.921424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aaa20cca-b548-4e57-91c7-a3a2f2aa9ec2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:52.922764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aaa20cca-b548-4e57-91c7-a3a2f2aa9ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:52.991328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1345/2710] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:52.999611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0514-2d93-4d91-8f02-0686cc5ece25 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:52.999758 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0514-2d93-4d91-8f02-0686cc5ece25 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.000015 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0514-2d93-4d91-8f02-0686cc5ece25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.024939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-289d0514-2d93-4d91-8f02-0686cc5ece25 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:53.026524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-289d0514-2d93-4d91-8f02-0686cc5ece25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:53.035596 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1366/2711] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:53.040086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20cca-b548-4e57-91c7-a3a2f2aa9ec2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:53.056290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20cca-b548-4e57-91c7-a3a2f2aa9ec2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:53.070295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:53.071084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.073737 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.074038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.075859 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:43:53.076239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:53.077948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:53.102728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1346/2712] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:43:53.107922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d0514-2d93-4d91-8f02-0686cc5ece25 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:53.118662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d0514-2d93-4d91-8f02-0686cc5ece25 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:53.124265 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:53.124889 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.125162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.125426 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.126191 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:53.128478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:53.147000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:53.174791 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1367/2713] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:53 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:53.176943 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:53.189462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd2a8-4772-42a9-9a24-98f1f5ef4b57 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:53.233845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:53.288979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:53.289649 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.289929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.290289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.292291 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:53.295031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:53.318488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1347/2714] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:53 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:53.322917 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:53.335145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9964d-1ef7-4c4d-9326-a74b854ce067 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:53.342375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:53.343564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.343564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.343800 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.344387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:53.346060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:53.358098 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1368/2715] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:53.362782 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:53.374623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfe17-19ba-4c63-a87d-3b35eb6124a7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:53.380304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82a14c-93a8-4b59-a331-c6d5a5a49db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:53.380920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a14c-93a8-4b59-a331-c6d5a5a49db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.381193 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a14c-93a8-4b59-a331-c6d5a5a49db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.381473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a14c-93a8-4b59-a331-c6d5a5a49db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.382173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82a14c-93a8-4b59-a331-c6d5a5a49db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:53.383909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82a14c-93a8-4b59-a331-c6d5a5a49db7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:53.399108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1348/2716] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:53.405712 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:53.418401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c281147-18ba-4e56-b745-9c25c4a46c26 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:53.423448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:53.424096 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.424371 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.424645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] PATH_INFO: `/v3/projects/837d6910946f49678d0caf95c10feb4c/users/5ed1325650fe4dad9e33663e4a2fb6db/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.448893 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=837d6910946f49678d0caf95c10feb4c, user_id=5ed1325650fe4dad9e33663e4a2fb6db, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:53.451808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:53.475612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1369/2717] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:53 2022] PUT /identity/v3/projects/837d6910946f49678d0caf95c10feb4c/users/5ed1325650fe4dad9e33663e4a2fb6db/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:43:53.489699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dee6d-b8d6-4b91-89d0-a40b23f51256 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.490238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dee6d-b8d6-4b91-89d0-a40b23f51256 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.491320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dee6d-b8d6-4b91-89d0-a40b23f51256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.554734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5c3dee6d-b8d6-4b91-89d0-a40b23f51256 None None] MFA Rules not processed for user `5ed1325650fe4dad9e33663e4a2fb6db`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:53.556289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5c3dee6d-b8d6-4b91-89d0-a40b23f51256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:53.672834 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1349/2718] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:53.683165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:53.685619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:53.799709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef693ebc-75ab-4847-8d95-edcec18c5aee admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:53.810695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3160eee18a4f7cb9f6880ec1b672a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:53.811632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:53.811996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:53.812357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:53.822431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:53.824043 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:53.841038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1370/2719] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:54.047820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db440147-a259-47c1-973f-44a79aa6c47b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:54.048735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db440147-a259-47c1-973f-44a79aa6c47b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:54.049226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db440147-a259-47c1-973f-44a79aa6c47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:54.108655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-db440147-a259-47c1-973f-44a79aa6c47b None None] MFA Rules not processed for user `5121b4edd870476a8082e4f5787a52ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:54.110552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-db440147-a259-47c1-973f-44a79aa6c47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:54.209952 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1350/2720] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:54.210803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:54.212311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:54.356549 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82224c-2a71-4cc0-be5d-46ec48ad4a38 service glance] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:54.361937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:54.362677 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:54.362982 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:54.363212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:54.363884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:54.365836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:54.437667 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1371/2721] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:43:54 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:54.443887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db440147-a259-47c1-973f-44a79aa6c47b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:54.458957 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db440147-a259-47c1-973f-44a79aa6c47b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:54.510297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:54.586328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:54.587061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:54.587411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:54.587882 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:54.588592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:54.591234 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:54.633402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1351/2722] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:43:54 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:43:54.634638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:54.645691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd10e9-edf1-4b3f-8621-4537006f2efb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:54.650447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:54.651056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:54.651330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:54.651598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:54.652240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:54.653888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:54.665574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1372/2723] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:43:54.669374 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:54.680192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff6b4b-f643-492d-b3d0-5703a5263ae6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:54.692220 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:54.693058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:54.693337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:54.693635 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] PATH_INFO: `/v3/projects/22621a82bbda4e41a2829d7af4eb3165/users/e0256d8836ac4ea9a3a6c1e8b551b064/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:54.711098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22621a82bbda4e41a2829d7af4eb3165, user_id=e0256d8836ac4ea9a3a6c1e8b551b064, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:54.713771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:54.731970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1352/2724] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:54 2022] PUT /identity/v3/projects/22621a82bbda4e41a2829d7af4eb3165/users/e0256d8836ac4ea9a3a6c1e8b551b064/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:54.737263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:54.747622 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd1c2-e54c-4c8d-869f-6dd72432edd6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:54.787574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:54.815781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:54.816500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:54.816871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:54.817462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:54.818255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:54.819939 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:54.834900 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1373/2725] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:43:54.835769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:54.849252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe273c8-0471-4cf9-9961-e9a673ba6d25 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:54.854823 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba7771-bd95-4468-ade6-7994431713cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:54.855500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba7771-bd95-4468-ade6-7994431713cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:54.855780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba7771-bd95-4468-ade6-7994431713cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:54.856055 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba7771-bd95-4468-ade6-7994431713cf admin admin] PATH_INFO: `/v3/projects/22621a82bbda4e41a2829d7af4eb3165/users/e0256d8836ac4ea9a3a6c1e8b551b064/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:54.859202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba7771-bd95-4468-ade6-7994431713cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=22621a82bbda4e41a2829d7af4eb3165, user_id=e0256d8836ac4ea9a3a6c1e8b551b064, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:54.862656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba7771-bd95-4468-ade6-7994431713cf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:54.878187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1353/2726] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:43:54 2022] PUT /identity/v3/projects/22621a82bbda4e41a2829d7af4eb3165/users/e0256d8836ac4ea9a3a6c1e8b551b064/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:58.765366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:58.768068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:58.790346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d3d5a-7f1e-4156-afdc-9e14e64fec59 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:58.912240 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:58.914438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:58.915490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:58.917402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] PATH_INFO: `/v3/users/b54d890032874c65a74a63d4113dc5fe` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:58.920795 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54d890032874c65a74a63d4113dc5fe)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:58.939938 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:59.045268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54d890032874c65a74a63d4113dc5fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:59.068118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54d890032874c65a74a63d4113dc5fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:59.081301 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54d890032874c65a74a63d4113dc5fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:59.082255 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54d890032874c65a74a63d4113dc5fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:59.082991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54d890032874c65a74a63d4113dc5fe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:43:59.121392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1374/2727] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:43:58 2022] DELETE /identity/v3/users/b54d890032874c65a74a63d4113dc5fe => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:43:59.123031 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27a5e-a535-42b2-916a-ae4542f13db1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:59.123615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27a5e-a535-42b2-916a-ae4542f13db1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:59.123615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a27a5e-a535-42b2-916a-ae4542f13db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:59.153776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-43a27a5e-a535-42b2-916a-ae4542f13db1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:59.155715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43a27a5e-a535-42b2-916a-ae4542f13db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:59.256157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1354/2728] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:59.268749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:59.270495 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:59.386658 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05dd75-d697-49ba-8331-d981c81840dc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:59.396707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:59.397421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:59.398503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:59.398854 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:59.411321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:43:59.416315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:43:59.418331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:43:59.434120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1375/2729] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:43:59.575252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:59.575532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:59.575815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:59.619314 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] MFA Rules not processed for user `e0256d8836ac4ea9a3a6c1e8b551b064`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:43:59.621258 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:59.738328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1355/2730] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:43:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:43:59.752496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:43:59.754269 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:59.885802 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76693bd4-7339-4e78-bceb-bf5ce93d7d60 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:43:59.893571 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae9ff9-df74-4912-b519-ce5ae3841d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:43:59.894487 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae9ff9-df74-4912-b519-ce5ae3841d7f service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:43:59.894611 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae9ff9-df74-4912-b519-ce5ae3841d7f service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:43:59.894834 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae9ff9-df74-4912-b519-ce5ae3841d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:43:59.897236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4fae9ff9-df74-4912-b519-ce5ae3841d7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:43:59.996254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae9ff9-df74-4912-b519-ce5ae3841d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.000808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae9ff9-df74-4912-b519-ce5ae3841d7f service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.017361 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1376/2731] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:43:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:00.194430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:00.195936 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:00.207837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:00.226698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9e6d9-cddb-4cda-b940-0d361df30ea7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:00.235484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:00.236256 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.236605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.237482 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] PATH_INFO: `/v3/projects/b0ebf3f5c657416abe56baa0a47edbb6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.241871 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ebf3f5c657416abe56baa0a47edbb6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.244349 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.332387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ebf3f5c657416abe56baa0a47edbb6', 'request_id': 'req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:00.340240 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ebf3f5c657416abe56baa0a47edbb6', 'request_id': 'req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:00.350172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ebf3f5c657416abe56baa0a47edbb6', 'request_id': 'req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:00.368715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] The token cache is being invalidate because project b0ebf3f5c657416abe56baa0a47edbb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:00.370186 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:00.371058 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdec2923-ff69-4fcf-b9a9-bfc377c9fa89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:00.380768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd328-4f47-46a0-bef0-935b8cd1c37b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.383971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd328-4f47-46a0-bef0-935b8cd1c37b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.384172 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1356/2732] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:00 2022] DELETE /identity/v3/projects/b0ebf3f5c657416abe56baa0a47edbb6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:00.385332 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acd328-4f47-46a0-bef0-935b8cd1c37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.413575 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-18acd328-4f47-46a0-bef0-935b8cd1c37b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:00.415253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-18acd328-4f47-46a0-bef0-935b8cd1c37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:00.534273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1377/2733] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:00.542141 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128426f-9ef9-4876-b6f3-9c38b9130f2f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.542911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128426f-9ef9-4876-b6f3-9c38b9130f2f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.542911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128426f-9ef9-4876-b6f3-9c38b9130f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.564885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1128426f-9ef9-4876-b6f3-9c38b9130f2f None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:00.566223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1128426f-9ef9-4876-b6f3-9c38b9130f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:00.578479 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1357/2734] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:00.583384 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd328-4f47-46a0-bef0-935b8cd1c37b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:00.595520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acd328-4f47-46a0-bef0-935b8cd1c37b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:00.600260 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:00.601005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.601288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.601678 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.602392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:00.602695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.604555 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.623258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1378/2735] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:44:00.625489 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128426f-9ef9-4876-b6f3-9c38b9130f2f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:00.645675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128426f-9ef9-4876-b6f3-9c38b9130f2f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:00.650985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:00.651738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.652083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.652419 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.653174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.655242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.687580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1358/2736] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:00 2022] POST /identity/v3/projects => generated 357 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:00.692339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:00.702675 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c55abb-fb5a-4d43-8f09-1dda1a72196b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:00.715878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:00.770451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:00.772016 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.772838 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.774112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.775692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.778880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.818419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1379/2737] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:00 2022] POST /identity/v3/users => generated 279 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:00.818629 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:00.829002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5baa0e-49c5-4455-8e58-5b6d092ed3fb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:00.834518 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:00.835156 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.835445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.835752 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.836342 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.838184 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.850790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1359/2738] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:00.866032 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:00.878141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a630e4-c0e6-4b65-a19f-e330c3d7ac0d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:00.886516 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740013b-c9f2-4b0c-8be9-df5d43af41c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:00.888060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740013b-c9f2-4b0c-8be9-df5d43af41c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.888512 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740013b-c9f2-4b0c-8be9-df5d43af41c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.888956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740013b-c9f2-4b0c-8be9-df5d43af41c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.889862 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740013b-c9f2-4b0c-8be9-df5d43af41c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.892137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740013b-c9f2-4b0c-8be9-df5d43af41c1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.907448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1380/2739] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:00.909004 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:00.920450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6db6-ffc4-4230-aa57-001e8de51b5d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:00.925803 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:00.926593 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.926901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.927228 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] PATH_INFO: `/v3/projects/bd844c69fa1a4df39b8e3d537090aa2d/users/ee656095ef5a4b4ca7da65446dd45b9a/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:00.945948 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd844c69fa1a4df39b8e3d537090aa2d, user_id=ee656095ef5a4b4ca7da65446dd45b9a, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:00.948639 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:00.967644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1360/2740] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:00 2022] PUT /identity/v3/projects/bd844c69fa1a4df39b8e3d537090aa2d/users/ee656095ef5a4b4ca7da65446dd45b9a/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:00.978038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc796b4b-260a-4e04-b85d-3db93da7022d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:00.978341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc796b4b-260a-4e04-b85d-3db93da7022d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:00.978609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc796b4b-260a-4e04-b85d-3db93da7022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.018754 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bc796b4b-260a-4e04-b85d-3db93da7022d None None] MFA Rules not processed for user `ee656095ef5a4b4ca7da65446dd45b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:01.019984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bc796b4b-260a-4e04-b85d-3db93da7022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:01.124710 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1381/2741] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:01.128926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:01.208484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eba264-e5f8-481c-b7a1-9b34fd9fefa1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:01.214267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1d039-b735-4fc8-8209-4a66c43f7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:01.215143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1d039-b735-4fc8-8209-4a66c43f7cde admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.215423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1d039-b735-4fc8-8209-4a66c43f7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.215832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1d039-b735-4fc8-8209-4a66c43f7cde admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.216461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1d039-b735-4fc8-8209-4a66c43f7cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:01.218668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1d039-b735-4fc8-8209-4a66c43f7cde admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:01.255769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1361/2742] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:01 2022] POST /identity/v3/projects => generated 355 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:01.260192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc796b4b-260a-4e04-b85d-3db93da7022d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:01.282537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c7ae-0906-4476-b1c4-01e019672a19 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.282963 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c7ae-0906-4476-b1c4-01e019672a19 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.283354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683c7ae-0906-4476-b1c4-01e019672a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.283941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc796b4b-260a-4e04-b85d-3db93da7022d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:01.301196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:01.310944 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a683c7ae-0906-4476-b1c4-01e019672a19 None None] MFA Rules not processed for user `5121b4edd870476a8082e4f5787a52ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:01.313908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a683c7ae-0906-4476-b1c4-01e019672a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:01.355402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:01.356091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.356389 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.356518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.357154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:01.359306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:01.396509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1362/2743] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:01.409961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1382/2744] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:01 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:01.412862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c7ae-0906-4476-b1c4-01e019672a19 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:01.430084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683c7ae-0906-4476-b1c4-01e019672a19 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:01.435556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:01.436526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.436911 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.437338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.438131 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:01.443858 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:01.458192 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1363/2745] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:01.462686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:01.475598 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05f2d2-8a8d-4c6b-81e0-2839accdde8d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:01.484309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:01.485424 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.485935 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.486208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] PATH_INFO: `/v3/projects/dec4d65a384b42908667c0644d2d0e91/users/50e4fdb5a72f45ebba4cec70f06ddd14/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.501013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:01.507880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec4d65a384b42908667c0644d2d0e91, user_id=50e4fdb5a72f45ebba4cec70f06ddd14, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:01.511346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:01.530039 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1383/2746] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:01 2022] PUT /identity/v3/projects/dec4d65a384b42908667c0644d2d0e91/users/50e4fdb5a72f45ebba4cec70f06ddd14/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:01.534066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:01.551139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c98657-a13a-4fc0-9567-83d171f54ac6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:01.626384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b52117-1ad8-4417-aea6-aaf2c59de8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:01.627044 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b52117-1ad8-4417-aea6-aaf2c59de8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.627324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b52117-1ad8-4417-aea6-aaf2c59de8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.627573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b52117-1ad8-4417-aea6-aaf2c59de8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.628232 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b52117-1ad8-4417-aea6-aaf2c59de8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:01.630006 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b52117-1ad8-4417-aea6-aaf2c59de8bb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:01.641614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1364/2747] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:01.646343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:01.666251 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17855590-1782-44fc-b2af-6a5ad57b8cd0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:01.678865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:01.679548 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.679824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.680095 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] PATH_INFO: `/v3/projects/dec4d65a384b42908667c0644d2d0e91/users/50e4fdb5a72f45ebba4cec70f06ddd14/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.682234 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec4d65a384b42908667c0644d2d0e91, user_id=50e4fdb5a72f45ebba4cec70f06ddd14, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:01.685012 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:01.702163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1384/2748] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:01 2022] PUT /identity/v3/projects/dec4d65a384b42908667c0644d2d0e91/users/50e4fdb5a72f45ebba4cec70f06ddd14/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:01.713359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081fdc0-6a3d-46ec-8477-f7d96212cbe0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.713715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081fdc0-6a3d-46ec-8477-f7d96212cbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.714129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081fdc0-6a3d-46ec-8477-f7d96212cbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.757324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c081fdc0-6a3d-46ec-8477-f7d96212cbe0 None None] MFA Rules not processed for user `50e4fdb5a72f45ebba4cec70f06ddd14`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:01.758960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c081fdc0-6a3d-46ec-8477-f7d96212cbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:01.846042 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1365/2749] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:01.858044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:01.860568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:01.958089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b5d93-ad86-4160-9d7b-ac56a2b5e1b0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:01.958089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:01.958089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:01.958089 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:01.959033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:01.970088 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:01.971642 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:01.983494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1385/2750] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:02.071299 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081fdc0-6a3d-46ec-8477-f7d96212cbe0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:02.082646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081fdc0-6a3d-46ec-8477-f7d96212cbe0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:02.086780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0181ef-4450-4f3c-9c8b-693d02f6dff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:02.087492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0181ef-4450-4f3c-9c8b-693d02f6dff4 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:02.087839 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0181ef-4450-4f3c-9c8b-693d02f6dff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:02.088176 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0181ef-4450-4f3c-9c8b-693d02f6dff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:02.108883 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:02.180421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0181ef-4450-4f3c-9c8b-693d02f6dff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:02.182355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0181ef-4450-4f3c-9c8b-693d02f6dff4 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:02.193693 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1366/2751] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:09.928544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:09.930168 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:10.001028 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b836594-4483-472c-a948-09c0e9346488 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:10.006221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:10.006856 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:10.007112 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:10.007397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] PATH_INFO: `/v3/users/5ed1325650fe4dad9e33663e4a2fb6db` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:10.008554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed1325650fe4dad9e33663e4a2fb6db)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:10.010499 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:10.061498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed1325650fe4dad9e33663e4a2fb6db'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.073033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed1325650fe4dad9e33663e4a2fb6db'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.081005 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed1325650fe4dad9e33663e4a2fb6db'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.082142 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed1325650fe4dad9e33663e4a2fb6db'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.082796 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed1325650fe4dad9e33663e4a2fb6db'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.096666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:10.099873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1386/2752] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:09 2022] DELETE /identity/v3/users/5ed1325650fe4dad9e33663e4a2fb6db => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:10.104856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:10.105377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:10.105588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:10.125910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:10.127125 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:10.188643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1367/2753] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:10.200321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:10.202069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:10.268892 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698661-7065-4497-9a6e-204449572db8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:10.272777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed4389-1c64-42d7-b286-245afe8b8bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:10.273392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4389-1c64-42d7-b286-245afe8b8bac service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:10.273703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4389-1c64-42d7-b286-245afe8b8bac service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:10.273975 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed4389-1c64-42d7-b286-245afe8b8bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:10.283581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed4389-1c64-42d7-b286-245afe8b8bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:10.285027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed4389-1c64-42d7-b286-245afe8b8bac service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:10.294522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1387/2754] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:44:10.588712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:10.590163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:10.609008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24db37-e166-4c04-be85-03c96130d55e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:10.614246 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:10.614881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:10.615152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:10.615421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] PATH_INFO: `/v3/projects/837d6910946f49678d0caf95c10feb4c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:10.616541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=837d6910946f49678d0caf95c10feb4c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:10.618534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:10.807377 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837d6910946f49678d0caf95c10feb4c', 'request_id': 'req-379f417c-b809-4642-98c5-3be40ea8fdec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.813144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837d6910946f49678d0caf95c10feb4c', 'request_id': 'req-379f417c-b809-4642-98c5-3be40ea8fdec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.821461 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837d6910946f49678d0caf95c10feb4c', 'request_id': 'req-379f417c-b809-4642-98c5-3be40ea8fdec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.833879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] The token cache is being invalidate because project 837d6910946f49678d0caf95c10feb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:10.834284 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.835039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-379f417c-b809-4642-98c5-3be40ea8fdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:10.836644 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1368/2755] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:10 2022] DELETE /identity/v3/projects/837d6910946f49678d0caf95c10feb4c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:10.841689 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76aa4-9181-422a-a00d-5e9427188362 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:10.841976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76aa4-9181-422a-a00d-5e9427188362 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:10.842247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe76aa4-9181-422a-a00d-5e9427188362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:10.862830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8fe76aa4-9181-422a-a00d-5e9427188362 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:10.863962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8fe76aa4-9181-422a-a00d-5e9427188362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:10.932846 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1388/2756] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:44:10.942366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e72cf-7d69-403f-8266-09ddda2d0155 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:10.942648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e72cf-7d69-403f-8266-09ddda2d0155 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:10.942917 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e72cf-7d69-403f-8266-09ddda2d0155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:10.964714 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-836e72cf-7d69-403f-8266-09ddda2d0155 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:10.965974 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-836e72cf-7d69-403f-8266-09ddda2d0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:10.975979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1369/2757] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:10.981304 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76aa4-9181-422a-a00d-5e9427188362 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:10.999345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe76aa4-9181-422a-a00d-5e9427188362 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:11.005025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:11.005662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.005944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.006212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.006864 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:11.007164 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:11.008763 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:11.021687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1389/2758] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:44:11.026115 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e72cf-7d69-403f-8266-09ddda2d0155 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:11.036467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e72cf-7d69-403f-8266-09ddda2d0155 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:11.041927 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:11.042521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.042810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.043079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.043701 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:11.045733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:11.081890 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1370/2759] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:11 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:11.086008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:11.096334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed068fc-2287-4b83-888c-065ca592901d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:11.156411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:11.157053 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.157402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.157606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.158258 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:11.160192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:11.182794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1390/2760] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:11 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:11.187293 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:11.198525 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a896-1dbb-49b9-a024-7a11cb73d4c7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:11.203456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:11.204108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.204376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.204646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.205297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:11.206947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:11.218202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1371/2761] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:11.222453 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:11.233127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec45c1-2d45-4059-a3b0-0164a64e5df2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:11.238993 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea089c08-aaa0-4948-b62c-984d291ca012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:11.240740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089c08-aaa0-4948-b62c-984d291ca012 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.241019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089c08-aaa0-4948-b62c-984d291ca012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.241289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089c08-aaa0-4948-b62c-984d291ca012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.241972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea089c08-aaa0-4948-b62c-984d291ca012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:11.243612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea089c08-aaa0-4948-b62c-984d291ca012 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:11.254542 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1391/2762] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:11.261388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:11.269436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:11.274062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466662e3-1053-429b-a54d-98f70a9ef9d4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:11.282021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:11.282679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.283201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.283610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] PATH_INFO: `/v3/projects/b7a616921881496f95bc816469f57565/users/0bfff45afc7c40bcad1372c50b6a12ef/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.299471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a616921881496f95bc816469f57565, user_id=0bfff45afc7c40bcad1372c50b6a12ef, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:11.302311 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:11.319087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1372/2763] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:11 2022] PUT /identity/v3/projects/b7a616921881496f95bc816469f57565/users/0bfff45afc7c40bcad1372c50b6a12ef/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:11.329964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545277b-73e3-4eab-9a57-f1e05363eb2d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.330250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545277b-73e3-4eab-9a57-f1e05363eb2d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.330527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545277b-73e3-4eab-9a57-f1e05363eb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.351991 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:11.361638 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6545277b-73e3-4eab-9a57-f1e05363eb2d None None] MFA Rules not processed for user `0bfff45afc7c40bcad1372c50b6a12ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:11.363529 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6545277b-73e3-4eab-9a57-f1e05363eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:11.437496 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1392/2764] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:11.445983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:11.448223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:11.520523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9508-772a-4975-913a-601ce8714442 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:11.524765 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09417ab-4555-4c9d-9926-02610ecb6375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:11.525373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09417ab-4555-4c9d-9926-02610ecb6375 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:11.525692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09417ab-4555-4c9d-9926-02610ecb6375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:11.525961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09417ab-4555-4c9d-9926-02610ecb6375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:11.534488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09417ab-4555-4c9d-9926-02610ecb6375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:11.535924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09417ab-4555-4c9d-9926-02610ecb6375 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:11.545424 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1373/2765] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:16.990536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545277b-73e3-4eab-9a57-f1e05363eb2d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.057093 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545277b-73e3-4eab-9a57-f1e05363eb2d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.062452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.063107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.063383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.063649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] PATH_INFO: `/v3/users/0bfff45afc7c40bcad1372c50b6a12ef` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.064787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfff45afc7c40bcad1372c50b6a12ef)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.066702 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:17.118773 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfff45afc7c40bcad1372c50b6a12ef'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.136135 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfff45afc7c40bcad1372c50b6a12ef'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.153456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfff45afc7c40bcad1372c50b6a12ef'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.157619 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfff45afc7c40bcad1372c50b6a12ef'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.158368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfff45afc7c40bcad1372c50b6a12ef'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.174267 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1393/2766] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:16 2022] DELETE /identity/v3/users/0bfff45afc7c40bcad1372c50b6a12ef => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:17.178874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.179406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.179406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.200229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:17.200229 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.260596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1374/2767] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:17.270951 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.272526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.294482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:17.337536 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30b296-e891-46d9-8a1b-0b330f8f2790 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.341705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4fff3-7a1c-48b7-bded-2966b3088f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.342314 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4fff3-7a1c-48b7-bded-2966b3088f7b service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.342687 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4fff3-7a1c-48b7-bded-2966b3088f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.343044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4fff3-7a1c-48b7-bded-2966b3088f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.343884 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.345381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.352992 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4fff3-7a1c-48b7-bded-2966b3088f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.354534 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4fff3-7a1c-48b7-bded-2966b3088f7b service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:17.357796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5eaf4-e08d-4bbb-9a85-e468529d6e97 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.363620 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.364276 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.364561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.364777 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1394/2768] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:17.364885 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] PATH_INFO: `/v3/users/ee656095ef5a4b4ca7da65446dd45b9a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.366071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee656095ef5a4b4ca7da65446dd45b9a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.367995 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:17.421777 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee656095ef5a4b4ca7da65446dd45b9a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.422539 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee656095ef5a4b4ca7da65446dd45b9a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.430748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee656095ef5a4b4ca7da65446dd45b9a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.439681 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee656095ef5a4b4ca7da65446dd45b9a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.440381 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee656095ef5a4b4ca7da65446dd45b9a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.452404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:17.462394 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1375/2769] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:17 2022] DELETE /identity/v3/users/ee656095ef5a4b4ca7da65446dd45b9a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:17.465963 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.466263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.466520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.487595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:17.488907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.557577 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1395/2770] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:17.564983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.566457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.626188 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ba5ca-af43-48fa-b24b-f7a567e760ea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.629912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c193ce-7c25-4830-b2ef-8a89b5cf4efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.630579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c193ce-7c25-4830-b2ef-8a89b5cf4efe service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.630866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c193ce-7c25-4830-b2ef-8a89b5cf4efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.631126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c193ce-7c25-4830-b2ef-8a89b5cf4efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.641745 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c193ce-7c25-4830-b2ef-8a89b5cf4efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.643185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c193ce-7c25-4830-b2ef-8a89b5cf4efe service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:17.653611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1376/2771] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:17.654488 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.656214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.671099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8979ef-6791-4b8d-8211-02dc1ca035c1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.676250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.677103 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.677455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.677819 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] PATH_INFO: `/v3/projects/b7a616921881496f95bc816469f57565` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.679041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a616921881496f95bc816469f57565)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.680997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:17.732631 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a616921881496f95bc816469f57565', 'request_id': 'req-9f39dd10-3e1e-4f62-972e-7198054e4005'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.740413 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a616921881496f95bc816469f57565', 'request_id': 'req-9f39dd10-3e1e-4f62-972e-7198054e4005'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.746392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a616921881496f95bc816469f57565', 'request_id': 'req-9f39dd10-3e1e-4f62-972e-7198054e4005'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.759580 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] The token cache is being invalidate because project b7a616921881496f95bc816469f57565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:17.759861 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.760491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f39dd10-3e1e-4f62-972e-7198054e4005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:17.762042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1396/2772] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:17 2022] DELETE /identity/v3/projects/b7a616921881496f95bc816469f57565 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:17.767050 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a71f-3fe4-4982-b818-a8bba41bc910 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.767365 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a71f-3fe4-4982-b818-a8bba41bc910 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.767696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a71f-3fe4-4982-b818-a8bba41bc910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.791348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-39b9a71f-3fe4-4982-b818-a8bba41bc910 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:17.792855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-39b9a71f-3fe4-4982-b818-a8bba41bc910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.870194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1377/2773] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:17.879126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.879408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.879680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.900990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:17.902237 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.914388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1397/2774] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:44:17.915308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a71f-3fe4-4982-b818-a8bba41bc910 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.925722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a71f-3fe4-4982-b818-a8bba41bc910 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.931129 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.932403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.932733 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.933077 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.933800 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:17.934120 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.936638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:17.951140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.952121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1378/2775] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:44:17.952697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:17.959608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:17.966061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8853568-f22a-4b96-a804-1171737e6e3b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.976250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.976864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1498f20-89d4-42e2-8771-d8b2b7d0f1a8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:17.977119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.977314 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.977613 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] PATH_INFO: `/v3/projects/bd844c69fa1a4df39b8e3d537090aa2d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.985573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd844c69fa1a4df39b8e3d537090aa2d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.987491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:17.990983 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:17.991596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:17.992000 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:17.992275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:17.992904 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:17.994812 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.025305 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:18.025898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1379/2776] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:17 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:18.029435 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.045768 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd844c69fa1a4df39b8e3d537090aa2d', 'request_id': 'req-3904a526-1d33-4965-891c-69b4108ba962'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.052858 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd844c69fa1a4df39b8e3d537090aa2d', 'request_id': 'req-3904a526-1d33-4965-891c-69b4108ba962'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.060387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd844c69fa1a4df39b8e3d537090aa2d', 'request_id': 'req-3904a526-1d33-4965-891c-69b4108ba962'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.078309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] The token cache is being invalidate because project bd844c69fa1a4df39b8e3d537090aa2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:18.078686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.079491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.083895 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1398/2777] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:17 2022] DELETE /identity/v3/projects/bd844c69fa1a4df39b8e3d537090aa2d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:18.084879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.086343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.099237 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60a75c-9ad5-4c5b-838f-773ef0e87016 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.105123 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.105856 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.106178 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.106512 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.107135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.109104 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.119567 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:18.137339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1380/2778] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:18 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:18.141466 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.143304 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.155688 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead229-f98e-4ad6-8c7d-b44a1cf373ea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.160940 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.161691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.162056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.162420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.163155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.164855 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.165099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904a526-1d33-4965-891c-69b4108ba962 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.169836 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.170467 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.170744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.171076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] PATH_INFO: `/v3/users/50e4fdb5a72f45ebba4cec70f06ddd14` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.172215 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e4fdb5a72f45ebba4cec70f06ddd14)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.174221 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.176157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1381/2779] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:44:18.179793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.189610 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed2c6d-846f-4d3a-bba6-8384d26fd995 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.194371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.194967 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.195242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.195509 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.196140 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.197796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.208665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1382/2780] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:44:18.212348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.214043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.227362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e4fdb5a72f45ebba4cec70f06ddd14'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.244485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e4fdb5a72f45ebba4cec70f06ddd14'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.252609 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e4fdb5a72f45ebba4cec70f06ddd14'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.253324 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e4fdb5a72f45ebba4cec70f06ddd14'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.253971 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e4fdb5a72f45ebba4cec70f06ddd14'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.271977 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1399/2781] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:18 2022] DELETE /identity/v3/users/50e4fdb5a72f45ebba4cec70f06ddd14 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:18.276425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.277425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.288934 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6acb4-32df-400e-8dad-0d6e73f25f6c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.329000 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:18.344281 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a397-5525-4a65-b8e4-64cb178f8680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.344873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a397-5525-4a65-b8e4-64cb178f8680 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.345151 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a397-5525-4a65-b8e4-64cb178f8680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.345420 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a397-5525-4a65-b8e4-64cb178f8680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.347846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8a80a397-5525-4a65-b8e4-64cb178f8680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.358770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a397-5525-4a65-b8e4-64cb178f8680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.360541 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a397-5525-4a65-b8e4-64cb178f8680 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.361076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8ffe9-cd2a-4452-8d5f-f66dcdd7cc04 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.367127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.367815 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.368170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.368358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] PATH_INFO: `/v3/projects/1f8b80fdd78e40a9af6882dba7c4090c/users/500be0a88c4f435bbc40a6c442825438/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.371827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1383/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:18.384345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8b80fdd78e40a9af6882dba7c4090c, user_id=500be0a88c4f435bbc40a6c442825438, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.387018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.402565 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1400/2783] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:18 2022] PUT /identity/v3/projects/1f8b80fdd78e40a9af6882dba7c4090c/users/500be0a88c4f435bbc40a6c442825438/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:18.470609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.470846 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.471148 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.523106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] MFA Rules not processed for user `500be0a88c4f435bbc40a6c442825438`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:18.524468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.606401 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1384/2784] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:18.622165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.622503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.623617 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:18.625238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.653231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:18.703659 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ede007-dbfd-45d1-85b0-9de563a5396d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.708546 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.709207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.709487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.709788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] PATH_INFO: `/v3/projects/dec4d65a384b42908667c0644d2d0e91` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.710915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec4d65a384b42908667c0644d2d0e91)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.711729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc740-d582-49ce-83bc-63c37b1dfe5e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:18.712818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.715435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96b8e4-0c20-4df2-a47f-463b1fb4e6d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d3160eee18a4f7cb9f6880ec1b672a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:18.716033 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b8e4-0c20-4df2-a47f-463b1fb4e6d0 service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.716316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b8e4-0c20-4df2-a47f-463b1fb4e6d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.716581 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96b8e4-0c20-4df2-a47f-463b1fb4e6d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.725352 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96b8e4-0c20-4df2-a47f-463b1fb4e6d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:18.726990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96b8e4-0c20-4df2-a47f-463b1fb4e6d0 service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:18.737110 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1401/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:18.776901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec4d65a384b42908667c0644d2d0e91', 'request_id': 'req-27406a00-b9ee-41fc-8867-49d9cf5a3d84'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.782976 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec4d65a384b42908667c0644d2d0e91', 'request_id': 'req-27406a00-b9ee-41fc-8867-49d9cf5a3d84'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.792249 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec4d65a384b42908667c0644d2d0e91', 'request_id': 'req-27406a00-b9ee-41fc-8867-49d9cf5a3d84'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.806169 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] The token cache is being invalidate because project dec4d65a384b42908667c0644d2d0e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:18.806794 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.807571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27406a00-b9ee-41fc-8867-49d9cf5a3d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:18.810061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1385/2786] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:18 2022] DELETE /identity/v3/projects/dec4d65a384b42908667c0644d2d0e91 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:18.814808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30518b0e-d7fd-4c59-b479-50d20326d594 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.815138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30518b0e-d7fd-4c59-b479-50d20326d594 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.815470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30518b0e-d7fd-4c59-b479-50d20326d594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.835504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-30518b0e-d7fd-4c59-b479-50d20326d594 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:18.836833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-30518b0e-d7fd-4c59-b479-50d20326d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.929721 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1402/2787] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:18.933702 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586dc7-0869-438b-b733-b07bab407381 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:18.933989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586dc7-0869-438b-b733-b07bab407381 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:18.934262 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586dc7-0869-438b-b733-b07bab407381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:18.976769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-60586dc7-0869-438b-b733-b07bab407381 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:18.978045 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60586dc7-0869-438b-b733-b07bab407381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:18.990998 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1386/2788] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:18.991729 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30518b0e-d7fd-4c59-b479-50d20326d594 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.002171 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30518b0e-d7fd-4c59-b479-50d20326d594 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.007293 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.007907 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.008186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.008456 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.009109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:19.009410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.011056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.024342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1403/2789] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:44:19.028805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60586dc7-0869-438b-b733-b07bab407381 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.039612 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60586dc7-0869-438b-b733-b07bab407381 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.045013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.046029 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.046278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.046810 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.047166 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.049202 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.083698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1387/2790] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:19 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:19.089331 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.100673 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca210356-b2d6-4e75-aa9b-42437a1bf655 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.157771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:19.169223 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.170429 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.170925 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.171362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.172337 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.174719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.214118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1404/2791] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:19 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:19.216510 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.228897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38bdac-229b-4200-b719-bb7c355d6a39 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.234472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.235772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.235772 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.235985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.236774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.239631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.255942 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1388/2792] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:19.256744 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.267458 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162647f-5b93-4650-a72e-b8eb212d3d22 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.272661 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5eaec-ee95-4218-8cf0-f32990949515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.273319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5eaec-ee95-4218-8cf0-f32990949515 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.273634 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5eaec-ee95-4218-8cf0-f32990949515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.273920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5eaec-ee95-4218-8cf0-f32990949515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.274515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5eaec-ee95-4218-8cf0-f32990949515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.276451 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5eaec-ee95-4218-8cf0-f32990949515 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.293586 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1405/2793] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:19.294923 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.305614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fca5e3-768c-4a26-99e3-846ad34e1335 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.310360 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.311041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.311317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.311711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] PATH_INFO: `/v3/projects/6c56f4f23d324ac485b66447a1b6efd6/users/843c4e0a18ec4bc8a65b584eae80cb02/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.328540 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c56f4f23d324ac485b66447a1b6efd6, user_id=843c4e0a18ec4bc8a65b584eae80cb02, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.331247 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.347571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1389/2794] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:19 2022] PUT /identity/v3/projects/6c56f4f23d324ac485b66447a1b6efd6/users/843c4e0a18ec4bc8a65b584eae80cb02/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:19.359038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773919a6-791a-480f-9df2-2087f743bdc5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.359317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773919a6-791a-480f-9df2-2087f743bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.359587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773919a6-791a-480f-9df2-2087f743bdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.403472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-773919a6-791a-480f-9df2-2087f743bdc5 None None] MFA Rules not processed for user `843c4e0a18ec4bc8a65b584eae80cb02`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:19.404979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-773919a6-791a-480f-9df2-2087f743bdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:19.480427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1406/2795] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:19.485722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.537167 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:19.555316 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478df7-486b-4863-b52a-d5eb8abb9765 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.562421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.563071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.563384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.563621 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.564278 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.566244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.601096 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1390/2796] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:19 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:19.605231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773919a6-791a-480f-9df2-2087f743bdc5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.617243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773919a6-791a-480f-9df2-2087f743bdc5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.677501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.678162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.678425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.678697 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.679404 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.681318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.705021 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1407/2797] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:19 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:19.709099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.719914 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff247c-6193-4da4-beae-63c9523bb18e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.724492 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.725099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.725375 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.725672 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.726312 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.727909 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.739458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1391/2798] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:44:19.744195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.754873 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67524957-f5a5-46a3-ba12-0466279b9a87 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.759897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.760573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.760860 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.761127 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] PATH_INFO: `/v3/projects/98a796279483459a9d7470fb43c4e995/users/6070b700b2314a1ca1970f603d15c593/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.776941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a796279483459a9d7470fb43c4e995, user_id=6070b700b2314a1ca1970f603d15c593, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.779651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.795731 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1408/2799] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:19 2022] PUT /identity/v3/projects/98a796279483459a9d7470fb43c4e995/users/6070b700b2314a1ca1970f603d15c593/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:19.800084 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.811024 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedc19f-daa8-4d33-a3b4-302a60433c6e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.869346 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acc5e0-fcac-43eb-ae5f-8583c66e092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.869894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc5e0-fcac-43eb-ae5f-8583c66e092d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.870175 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc5e0-fcac-43eb-ae5f-8583c66e092d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.870438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acc5e0-fcac-43eb-ae5f-8583c66e092d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.871087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acc5e0-fcac-43eb-ae5f-8583c66e092d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.872735 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acc5e0-fcac-43eb-ae5f-8583c66e092d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.883455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1392/2800] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:19.888008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:19.899494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9555-f24f-4c6a-af94-43386e0c43b1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:19.904817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:19.905560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.905849 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.906122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] PATH_INFO: `/v3/projects/98a796279483459a9d7470fb43c4e995/users/6070b700b2314a1ca1970f603d15c593/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.908212 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a796279483459a9d7470fb43c4e995, user_id=6070b700b2314a1ca1970f603d15c593, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:19.911173 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:19.923063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1409/2801] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:19 2022] PUT /identity/v3/projects/98a796279483459a9d7470fb43c4e995/users/6070b700b2314a1ca1970f603d15c593/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:19.934527 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d51b9-d133-4b21-a150-a02b450a995b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:19.934811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d51b9-d133-4b21-a150-a02b450a995b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:19.935083 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d51b9-d133-4b21-a150-a02b450a995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:19.969408 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-902d51b9-d133-4b21-a150-a02b450a995b None None] MFA Rules not processed for user `6070b700b2314a1ca1970f603d15c593`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:19.970685 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-902d51b9-d133-4b21-a150-a02b450a995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:20.069623 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1393/2802] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:20.084830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:20.088084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:20.105604 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:20.182155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf954419-5138-44b1-bd4a-e8bf58c93e09 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:20.186839 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:20.187717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:20.188099 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:20.188476 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:20.199055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:20.200576 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:20.210960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1410/2803] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:20.326696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d51b9-d133-4b21-a150-a02b450a995b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:20.337982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d51b9-d133-4b21-a150-a02b450a995b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:20.342099 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e59129-451d-448f-be40-6960ac11e6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:20.342973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59129-451d-448f-be40-6960ac11e6ba service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:20.343376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59129-451d-448f-be40-6960ac11e6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:20.343668 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e59129-451d-448f-be40-6960ac11e6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:20.389984 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:20.414722 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e59129-451d-448f-be40-6960ac11e6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:20.416352 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e59129-451d-448f-be40-6960ac11e6ba service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:20.426700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1394/2804] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:20.732700 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:20.805626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb928-ce0c-48e3-98f7-aa4d9e42d5e5 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:20.810978 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:20.813526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:20.813922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:20.814286 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] PATH_INFO: `/v3/users/843c4e0a18ec4bc8a65b584eae80cb02` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:20.815656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843c4e0a18ec4bc8a65b584eae80cb02)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:20.817737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:20.881913 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843c4e0a18ec4bc8a65b584eae80cb02'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:20.899408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843c4e0a18ec4bc8a65b584eae80cb02'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:20.908669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843c4e0a18ec4bc8a65b584eae80cb02'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:20.909463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843c4e0a18ec4bc8a65b584eae80cb02'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:20.910418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843c4e0a18ec4bc8a65b584eae80cb02'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:20.931558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1411/2805] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:20 2022] DELETE /identity/v3/users/843c4e0a18ec4bc8a65b584eae80cb02 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:20.936152 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:20.936615 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:20.936986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:20.959146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:20.960372 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:21.036922 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1395/2806] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:44:21.047390 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:21.052646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:21.101828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:21.123029 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f00786-34c5-482a-837a-d0fe13a626d6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:21.127018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:21.127624 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:21.127901 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:21.128350 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:21.139498 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:21.141006 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:21.151652 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1412/2807] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:21.779071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:21.780595 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:21.796061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5051b-24d4-420b-9b2d-b64ee9d927cc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:21.800958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:21.801774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:21.802049 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:21.802317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] PATH_INFO: `/v3/projects/6c56f4f23d324ac485b66447a1b6efd6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:21.803430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c56f4f23d324ac485b66447a1b6efd6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:21.805324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:21.864196 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c56f4f23d324ac485b66447a1b6efd6', 'request_id': 'req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:21.869915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c56f4f23d324ac485b66447a1b6efd6', 'request_id': 'req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:21.879297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c56f4f23d324ac485b66447a1b6efd6', 'request_id': 'req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:21.891400 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] The token cache is being invalidate because project 6c56f4f23d324ac485b66447a1b6efd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:21.891691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:21.892332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:21.893892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1396/2808] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:21 2022] DELETE /identity/v3/projects/6c56f4f23d324ac485b66447a1b6efd6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:21.897932 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:21.908329 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55579963-58a7-4013-94be-db39d749bff7 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:21.974100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:21.974745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:21.975014 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:21.975281 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] PATH_INFO: `/v3/users/6070b700b2314a1ca1970f603d15c593` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:21.976401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6070b700b2314a1ca1970f603d15c593)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:21.978831 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:22.038116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6070b700b2314a1ca1970f603d15c593'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.050941 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6070b700b2314a1ca1970f603d15c593'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.058195 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6070b700b2314a1ca1970f603d15c593'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.058954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6070b700b2314a1ca1970f603d15c593'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.059545 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8d20d64-b140-4638-990d-f4e7687cbdb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6070b700b2314a1ca1970f603d15c593'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.075156 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1413/2809] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:21 2022] DELETE /identity/v3/users/6070b700b2314a1ca1970f603d15c593 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:22.364625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:22.366243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:22.386978 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0251bd-8f4b-411b-9392-a79ebcbe4cf2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:22.451422 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:22.451947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.452274 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.452552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] PATH_INFO: `/v3/projects/98a796279483459a9d7470fb43c4e995` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.453742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a796279483459a9d7470fb43c4e995)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:22.455724 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:22.462473 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:22.509837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a796279483459a9d7470fb43c4e995', 'request_id': 'req-0a296a5b-8fb4-4baa-9080-50c460114f84'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.515450 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a796279483459a9d7470fb43c4e995', 'request_id': 'req-0a296a5b-8fb4-4baa-9080-50c460114f84'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.525382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a796279483459a9d7470fb43c4e995', 'request_id': 'req-0a296a5b-8fb4-4baa-9080-50c460114f84'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.538214 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] The token cache is being invalidate because project 98a796279483459a9d7470fb43c4e995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:22.538454 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.539183 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0a296a5b-8fb4-4baa-9080-50c460114f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:22.540711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1397/2810] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:22 2022] DELETE /identity/v3/projects/98a796279483459a9d7470fb43c4e995 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:22.546019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831259b9-0a2e-4933-b124-2bf58ca6ab14 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.546561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831259b9-0a2e-4933-b124-2bf58ca6ab14 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.546693 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831259b9-0a2e-4933-b124-2bf58ca6ab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.569759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-831259b9-0a2e-4933-b124-2bf58ca6ab14 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:22.570976 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-831259b9-0a2e-4933-b124-2bf58ca6ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:22.625216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:22.638435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1414/2811] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:22.646736 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62610b0-89e1-4697-bdb9-0f0459ee2dcb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.647026 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62610b0-89e1-4697-bdb9-0f0459ee2dcb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.647307 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62610b0-89e1-4697-bdb9-0f0459ee2dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.668603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a62610b0-89e1-4697-bdb9-0f0459ee2dcb None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:22.669849 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a62610b0-89e1-4697-bdb9-0f0459ee2dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:22.678488 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1398/2812] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:22.683068 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831259b9-0a2e-4933-b124-2bf58ca6ab14 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:22.693651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831259b9-0a2e-4933-b124-2bf58ca6ab14 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:22.698897 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:22.699500 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.699775 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.700042 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.700692 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:22.700995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:22.702751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:22.715214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1415/2813] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:44:22.720243 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62610b0-89e1-4697-bdb9-0f0459ee2dcb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:22.735279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62610b0-89e1-4697-bdb9-0f0459ee2dcb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:22.741640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:22.742165 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.742468 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.742719 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.743411 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:22.745712 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:22.774939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1399/2814] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:22 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:22.779929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:22.790376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9aa28-fa24-4b74-b40c-0f4535048ebd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:22.852924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:22.853660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.853972 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.854208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.854851 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:22.856769 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:22.884363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1416/2815] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:22 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:22.885683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:22.899438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4541a-35e8-4689-942f-7a3751cb5b83 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:22.906252 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:22.906867 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.907146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.907444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.908098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:22.909790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:22.922074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1400/2816] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:22.926261 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:22.937247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0eac6-0c29-466f-a071-69e50d89477a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:22.944338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a772d-e59b-4d8a-8289-824b2e4bd91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:22.945086 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a772d-e59b-4d8a-8289-824b2e4bd91c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.945364 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a772d-e59b-4d8a-8289-824b2e4bd91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.945662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a772d-e59b-4d8a-8289-824b2e4bd91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:22.946493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a772d-e59b-4d8a-8289-824b2e4bd91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:22.949584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a772d-e59b-4d8a-8289-824b2e4bd91c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:22.962114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1417/2817] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:22.966537 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:22.977731 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847c2db-7d13-48f7-9f99-94b1fc270667 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:22.983309 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:22.984137 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:22.984504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:22.985097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] PATH_INFO: `/v3/projects/6127dd901d814aea9b796678262606bb/users/5fe80bce8f274accb21b9d88aca2ba8e/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.014190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6127dd901d814aea9b796678262606bb, user_id=5fe80bce8f274accb21b9d88aca2ba8e, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.016912 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.032887 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1401/2818] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:22 2022] PUT /identity/v3/projects/6127dd901d814aea9b796678262606bb/users/5fe80bce8f274accb21b9d88aca2ba8e/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:23.043509 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218111-b649-4da1-b3d7-6489b8c3a0d0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.043903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218111-b649-4da1-b3d7-6489b8c3a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.044177 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218111-b649-4da1-b3d7-6489b8c3a0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.077037 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c4218111-b649-4da1-b3d7-6489b8c3a0d0 None None] MFA Rules not processed for user `5fe80bce8f274accb21b9d88aca2ba8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:23.078319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c4218111-b649-4da1-b3d7-6489b8c3a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:23.149520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1418/2819] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:23.154526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:23.221266 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3c6b3-c7fb-4522-87cd-07be91cf8e72 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:23.226448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:23.227057 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.227335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.227592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.228303 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.230436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.264185 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1402/2820] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:23 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:23.268425 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218111-b649-4da1-b3d7-6489b8c3a0d0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:23.280369 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218111-b649-4da1-b3d7-6489b8c3a0d0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:23.338523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:23.348525 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:23.349336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.349865 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.350370 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.351074 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.353019 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.379703 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1419/2821] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:23 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:23.381143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:23.392390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db712a-3864-4d67-a165-badf6e1e33af admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:23.397110 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:23.397779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.398066 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.398335 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.399008 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.400640 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.415730 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1403/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:23.417317 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:23.427960 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7af8ed-433b-4fbe-992e-c0d397f8e101 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:23.433084 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:23.433764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.434041 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.434313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] PATH_INFO: `/v3/projects/786f7bf2ad744a4e843ded5c55b3178d/users/00a52db01f574f71bb7d7b56de3f22c5/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.455879 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=786f7bf2ad744a4e843ded5c55b3178d, user_id=00a52db01f574f71bb7d7b56de3f22c5, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.458606 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.477924 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1420/2823] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:23 2022] PUT /identity/v3/projects/786f7bf2ad744a4e843ded5c55b3178d/users/00a52db01f574f71bb7d7b56de3f22c5/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:23.482020 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:23.489325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:23.493847 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2d2fa-d703-4936-b675-4227faf914f2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:23.560135 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218db1b-3f35-4be3-bfea-97dc93c49f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:23.560783 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218db1b-3f35-4be3-bfea-97dc93c49f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.561062 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218db1b-3f35-4be3-bfea-97dc93c49f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.561332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218db1b-3f35-4be3-bfea-97dc93c49f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.562011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218db1b-3f35-4be3-bfea-97dc93c49f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.563626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218db1b-3f35-4be3-bfea-97dc93c49f50 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.574173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1404/2824] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:23.578632 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:23.589560 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f43e0-d749-499b-91e8-6bbdc8afaa1d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:23.594663 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:23.595311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.595592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.595891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] PATH_INFO: `/v3/projects/786f7bf2ad744a4e843ded5c55b3178d/users/00a52db01f574f71bb7d7b56de3f22c5/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.597911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786f7bf2ad744a4e843ded5c55b3178d, user_id=00a52db01f574f71bb7d7b56de3f22c5, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.600595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.612158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1421/2825] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:23 2022] PUT /identity/v3/projects/786f7bf2ad744a4e843ded5c55b3178d/users/00a52db01f574f71bb7d7b56de3f22c5/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:23.623520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.623832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.624171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.655086 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] MFA Rules not processed for user `00a52db01f574f71bb7d7b56de3f22c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:23.656378 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:23.728268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1405/2826] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:23.740523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:23.742320 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:23.804464 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0cd9f-c927-4c1a-800a-796a7ce0e9b9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:23.808890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:23.809506 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:23.809886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:23.810100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:23.868614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:23.870108 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:23.882236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1422/2827] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:28.191905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:28.193579 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:28.206082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d10b1-1e3b-4187-abd1-c989d01f78ec None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:28.209894 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:28.210495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:28.210773 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:28.211041 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:28.221289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:28.222776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:28.232902 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1406/2828] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:30.316357 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:30.318138 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:30.377943 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4974a-5e39-443a-bd96-359c0011918e service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:30.381713 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc0404-96c5-45d1-bdaa-4093e96540cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:30.382460 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0404-96c5-45d1-bdaa-4093e96540cf service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:30.382755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0404-96c5-45d1-bdaa-4093e96540cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:30.382996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc0404-96c5-45d1-bdaa-4093e96540cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:30.384764 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-56fc0404-96c5-45d1-bdaa-4093e96540cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:30.398659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:30.451366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc0404-96c5-45d1-bdaa-4093e96540cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:30.452786 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc0404-96c5-45d1-bdaa-4093e96540cf service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:30.463828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1423/2829] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:33.173665 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:33.241033 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef39def-3cbb-427b-b204-8f6844be50a3 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:33.246271 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:33.246910 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:33.247190 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:33.247462 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] PATH_INFO: `/v3/users/5fe80bce8f274accb21b9d88aca2ba8e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:33.248648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe80bce8f274accb21b9d88aca2ba8e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:33.250780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:33.267036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:33.302965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe80bce8f274accb21b9d88aca2ba8e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.303667 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe80bce8f274accb21b9d88aca2ba8e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.310868 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe80bce8f274accb21b9d88aca2ba8e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.324021 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe80bce8f274accb21b9d88aca2ba8e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.324700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe80bce8f274accb21b9d88aca2ba8e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.342840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1407/2830] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:33 2022] DELETE /identity/v3/users/5fe80bce8f274accb21b9d88aca2ba8e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:33.347230 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:33.348538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:33.348923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:33.369288 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:33.370599 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:33.445749 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1424/2831] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:33.458456 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:33.465395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:33.533345 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a831-8314-4108-b6b6-8f7684ef7f96 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:33.537366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:33.538002 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:33.538415 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:33.538531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:33.547845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:33.549275 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:33.558774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1408/2832] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:33.856704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:33.858330 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:33.874590 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847c40b-4422-471b-a2c5-f4ad336c9f62 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:33.879363 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:33.880216 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:33.880489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:33.880756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] PATH_INFO: `/v3/projects/6127dd901d814aea9b796678262606bb` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:33.882192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6127dd901d814aea9b796678262606bb)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:33.884402 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:33.934956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6127dd901d814aea9b796678262606bb', 'request_id': 'req-957fc14b-c638-4631-8087-2feff294ca77'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.941166 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6127dd901d814aea9b796678262606bb', 'request_id': 'req-957fc14b-c638-4631-8087-2feff294ca77'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.947027 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6127dd901d814aea9b796678262606bb', 'request_id': 'req-957fc14b-c638-4631-8087-2feff294ca77'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.960205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] The token cache is being invalidate because project 6127dd901d814aea9b796678262606bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:33.960554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.961227 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:33.962840 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1425/2833] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:33 2022] DELETE /identity/v3/projects/6127dd901d814aea9b796678262606bb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:33.967139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:33.977203 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd82f-1d61-48b9-bf92-7835f003917f service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:34.036742 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:34.037371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.037679 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.037950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] PATH_INFO: `/v3/users/00a52db01f574f71bb7d7b56de3f22c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.039092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a52db01f574f71bb7d7b56de3f22c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:34.041011 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:34.086421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:34.097691 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a52db01f574f71bb7d7b56de3f22c5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.098565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a52db01f574f71bb7d7b56de3f22c5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.105822 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a52db01f574f71bb7d7b56de3f22c5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.114874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a52db01f574f71bb7d7b56de3f22c5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.115543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e082ce6a-5536-420e-945f-14a51194a11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a52db01f574f71bb7d7b56de3f22c5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.134833 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1409/2834] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:33 2022] DELETE /identity/v3/users/00a52db01f574f71bb7d7b56de3f22c5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:34.414558 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:34.416018 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:34.435052 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fc14b-c638-4631-8087-2feff294ca77 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:34.466738 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:34.495933 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:34.496564 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.496845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.497116 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] PATH_INFO: `/v3/projects/786f7bf2ad744a4e843ded5c55b3178d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.498254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=786f7bf2ad744a4e843ded5c55b3178d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:34.500244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:34.547614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786f7bf2ad744a4e843ded5c55b3178d', 'request_id': 'req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.553704 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786f7bf2ad744a4e843ded5c55b3178d', 'request_id': 'req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.559920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786f7bf2ad744a4e843ded5c55b3178d', 'request_id': 'req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.574657 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] The token cache is being invalidate because project 786f7bf2ad744a4e843ded5c55b3178d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:34.574968 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.575584 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-93cb325f-e0da-47e3-9ccf-fe05d2cfb92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:34.577118 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1426/2835] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:34 2022] DELETE /identity/v3/projects/786f7bf2ad744a4e843ded5c55b3178d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:34.583194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc1aa1-9ecd-44eb-8bcb-d2a71175f7cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.583675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc1aa1-9ecd-44eb-8bcb-d2a71175f7cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.583788 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc1aa1-9ecd-44eb-8bcb-d2a71175f7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.604586 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2bcc1aa1-9ecd-44eb-8bcb-d2a71175f7cf None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:34.605853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2bcc1aa1-9ecd-44eb-8bcb-d2a71175f7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:34.677213 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1410/2836] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:34.685823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc51f-b50a-4120-b55c-a317d10894b9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.686311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc51f-b50a-4120-b55c-a317d10894b9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.686583 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cc51f-b50a-4120-b55c-a317d10894b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.707485 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a28cc51f-b50a-4120-b55c-a317d10894b9 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:34.708672 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a28cc51f-b50a-4120-b55c-a317d10894b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:34.718421 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1427/2837] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:44:34.722832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc1aa1-9ecd-44eb-8bcb-d2a71175f7cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:34.732744 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc1aa1-9ecd-44eb-8bcb-d2a71175f7cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:34.738001 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:34.738770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.739030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.739297 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.739931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:34.740223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:34.741815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:34.753607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1411/2838] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:44:34.758280 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cc51f-b50a-4120-b55c-a317d10894b9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:34.767843 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cc51f-b50a-4120-b55c-a317d10894b9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:34.773887 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:34.774482 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.774756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.775024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.775648 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:34.777532 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:34.810178 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1428/2839] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:34 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:34.814373 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:34.824619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2346b-2dd7-459b-ab59-504d3baa11c5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:34.883376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:34.884211 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.884472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.884739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.885387 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:34.887493 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:34.916143 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1412/2840] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:34 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:34.917585 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:34.928741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c54045-8a61-4374-b708-65b198d32130 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:34.934356 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:34.935045 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.935339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.935651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.936419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:34.938087 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:34.948911 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1429/2841] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:34.952807 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:34.963888 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6541957-4352-4df1-ac2e-18d1136d4949 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:34.968900 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5b0fd-841f-4298-b7fb-4dfa0718d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:34.969503 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b0fd-841f-4298-b7fb-4dfa0718d73f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:34.969817 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b0fd-841f-4298-b7fb-4dfa0718d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:34.970097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b0fd-841f-4298-b7fb-4dfa0718d73f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:34.970739 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5b0fd-841f-4298-b7fb-4dfa0718d73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:34.972398 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5b0fd-841f-4298-b7fb-4dfa0718d73f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:34.983718 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1413/2842] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:34.988274 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:34.999228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19065f2e-0e5c-407c-8eb6-1a615d29182b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:35.004508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:35.005157 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:35.005435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:35.005781 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] PATH_INFO: `/v3/projects/300a2abdb2fd4a1c85db6359fbe76bac/users/57bdcb47d80f48708eb4dd7d87c99db3/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:35.022397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=300a2abdb2fd4a1c85db6359fbe76bac, user_id=57bdcb47d80f48708eb4dd7d87c99db3, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:35.025055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:35.038891 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1430/2843] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:34 2022] PUT /identity/v3/projects/300a2abdb2fd4a1c85db6359fbe76bac/users/57bdcb47d80f48708eb4dd7d87c99db3/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:35.051762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347740aa-2018-466d-8bc9-fd30b6155a5f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:35.051895 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347740aa-2018-466d-8bc9-fd30b6155a5f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:35.052074 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347740aa-2018-466d-8bc9-fd30b6155a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:35.089580 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-347740aa-2018-466d-8bc9-fd30b6155a5f None None] MFA Rules not processed for user `57bdcb47d80f48708eb4dd7d87c99db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:35.090799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-347740aa-2018-466d-8bc9-fd30b6155a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:35.099502 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:35.167573 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1414/2844] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:35.206681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:35.208884 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:35.268196 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d39b5e-089d-4ad3-883e-79218d5743bd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:35.272192 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a44f39-4359-47d9-b3a9-bbdf590cf734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:35.272778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a44f39-4359-47d9-b3a9-bbdf590cf734 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:35.273044 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a44f39-4359-47d9-b3a9-bbdf590cf734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:35.273311 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a44f39-4359-47d9-b3a9-bbdf590cf734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:35.281817 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a44f39-4359-47d9-b3a9-bbdf590cf734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:35.283236 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a44f39-4359-47d9-b3a9-bbdf590cf734 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:35.292025 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1431/2845] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:35.307390 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347740aa-2018-466d-8bc9-fd30b6155a5f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:35.373841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347740aa-2018-466d-8bc9-fd30b6155a5f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:35.379519 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:35.380171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:35.380448 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:35.380717 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] PATH_INFO: `/v3/users/57bdcb47d80f48708eb4dd7d87c99db3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:35.381905 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bdcb47d80f48708eb4dd7d87c99db3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:35.383841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:35.433320 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bdcb47d80f48708eb4dd7d87c99db3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:35.433930 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bdcb47d80f48708eb4dd7d87c99db3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:35.440931 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bdcb47d80f48708eb4dd7d87c99db3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:35.451318 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bdcb47d80f48708eb4dd7d87c99db3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:35.451994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bdcb47d80f48708eb4dd7d87c99db3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:35.471755 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1415/2846] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:35 2022] DELETE /identity/v3/users/57bdcb47d80f48708eb4dd7d87c99db3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:35.476541 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:35.477040 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:35.477144 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:35.484342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:35.499187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:35.500444 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:35.561289 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1432/2847] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:35.574698 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:35.577036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:35.609321 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:35.638421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dbda4-707a-429f-93da-52080d19dd9f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:35.642816 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e9189-0640-4d0e-bb59-a458b60ddc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:35.643423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e9189-0640-4d0e-bb59-a458b60ddc07 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:35.643686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e9189-0640-4d0e-bb59-a458b60ddc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:35.643972 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e9189-0640-4d0e-bb59-a458b60ddc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:35.653467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e9189-0640-4d0e-bb59-a458b60ddc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:35.654989 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e9189-0640-4d0e-bb59-a458b60ddc07 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:35.664965 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1416/2848] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:35.939762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:35.941202 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:35.955105 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155646f-fd68-47cd-9350-fa13dfd0ffb5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:35.960113 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:35.960745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:35.961017 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:35.961292 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] PATH_INFO: `/v3/projects/300a2abdb2fd4a1c85db6359fbe76bac` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:35.963608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=300a2abdb2fd4a1c85db6359fbe76bac)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:35.971189 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.020920 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300a2abdb2fd4a1c85db6359fbe76bac', 'request_id': 'req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:36.027268 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300a2abdb2fd4a1c85db6359fbe76bac', 'request_id': 'req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:36.033100 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300a2abdb2fd4a1c85db6359fbe76bac', 'request_id': 'req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:36.047544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] The token cache is being invalidate because project 300a2abdb2fd4a1c85db6359fbe76bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:36.047828 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:36.048459 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-7ad354ac-a9dd-48a8-9a44-1c1a1dfb78bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:36.049979 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1433/2849] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:35 2022] DELETE /identity/v3/projects/300a2abdb2fd4a1c85db6359fbe76bac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:36.055072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22badefe-4611-4543-9d16-294ca3618e50 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.055355 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22badefe-4611-4543-9d16-294ca3618e50 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.055619 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22badefe-4611-4543-9d16-294ca3618e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.077348 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-22badefe-4611-4543-9d16-294ca3618e50 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:36.078592 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-22badefe-4611-4543-9d16-294ca3618e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:36.140464 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1417/2850] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:36.148423 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97c8be-9695-44e4-9fec-0f6fce31328e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.148720 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97c8be-9695-44e4-9fec-0f6fce31328e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.148989 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97c8be-9695-44e4-9fec-0f6fce31328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.169418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bf97c8be-9695-44e4-9fec-0f6fce31328e None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:36.170816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf97c8be-9695-44e4-9fec-0f6fce31328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:36.179252 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1434/2851] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:36.183628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22badefe-4611-4543-9d16-294ca3618e50 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.193956 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22badefe-4611-4543-9d16-294ca3618e50 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.199465 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.200056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.200337 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.200605 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.201257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:36.201584 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.203290 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.218705 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1418/2852] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:44:36.220447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97c8be-9695-44e4-9fec-0f6fce31328e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.230315 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97c8be-9695-44e4-9fec-0f6fce31328e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.235452 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.236056 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.236334 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.236601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.237365 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.239284 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.268808 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1435/2853] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:36 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:36.273338 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.284458 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b6fd-65d2-4ecb-8815-21d55f172ae2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.346265 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.346866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.347139 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.347403 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.348030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.349977 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.375028 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1419/2854] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:36 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:36.379608 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.390568 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb42a-f159-483c-930f-c725d6b81718 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.395726 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.396348 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.396666 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.397002 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.397822 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.399740 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.410427 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1436/2855] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:36.414648 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.425331 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771b78d-8923-4173-873e-fe5739a4919f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.431526 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473857d-27b7-43c0-9427-a5000ca89d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.432126 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473857d-27b7-43c0-9427-a5000ca89d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.432404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473857d-27b7-43c0-9427-a5000ca89d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.432676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473857d-27b7-43c0-9427-a5000ca89d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.433315 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473857d-27b7-43c0-9427-a5000ca89d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.434958 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473857d-27b7-43c0-9427-a5000ca89d6d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.446027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1420/2856] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:36.450434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.461047 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91977d-3c40-41ff-986b-4184b6517075 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.466832 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.467554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.467835 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.468107 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] PATH_INFO: `/v3/projects/375b766bab394eaa977c230fe4c2f98a/users/07be25a8f04846ce99a281c04c67171d/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.485554 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375b766bab394eaa977c230fe4c2f98a, user_id=07be25a8f04846ce99a281c04c67171d, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.488226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.504186 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1437/2857] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:36 2022] PUT /identity/v3/projects/375b766bab394eaa977c230fe4c2f98a/users/07be25a8f04846ce99a281c04c67171d/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:36.515405 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94a58a-ee01-49f2-a198-88c4c07e56c6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.515776 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94a58a-ee01-49f2-a198-88c4c07e56c6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.516171 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94a58a-ee01-49f2-a198-88c4c07e56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.551395 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1b94a58a-ee01-49f2-a198-88c4c07e56c6 None None] MFA Rules not processed for user `07be25a8f04846ce99a281c04c67171d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:36.552771 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1b94a58a-ee01-49f2-a198-88c4c07e56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:36.583359 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:36.639587 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1421/2858] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:36.644297 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.671515 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:36.710994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce7ac-68ac-42b3-8a2a-1fbd7aae49f2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.716162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.716752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.717038 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.717309 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.717999 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.719894 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.751172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1438/2859] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:36 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:36.755603 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94a58a-ee01-49f2-a198-88c4c07e56c6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.767413 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94a58a-ee01-49f2-a198-88c4c07e56c6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.826032 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.826534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.826813 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.827136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.827764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.829708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.853982 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1422/2860] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:36 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:36.858061 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.869520 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1bedf-c57f-4c95-9593-17a278f8675f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.875262 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.875881 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.876155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.876434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.877065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.878681 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.889756 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1439/2861] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:36.893908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.904775 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a075158-cb91-42ae-a3a6-a4a8f1065eec admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:36.910574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:36.911339 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:36.911588 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:36.911873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] PATH_INFO: `/v3/projects/661d545ee3dd4b379f1a5f3ecc44eaec/users/46f3e7945e21409aab22e845fe16b768/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:36.927726 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=661d545ee3dd4b379f1a5f3ecc44eaec, user_id=46f3e7945e21409aab22e845fe16b768, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:36.930421 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:36.945065 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1423/2862] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:36 2022] PUT /identity/v3/projects/661d545ee3dd4b379f1a5f3ecc44eaec/users/46f3e7945e21409aab22e845fe16b768/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:36.949285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:36.959745 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f99af3-73bb-44db-aaa6-3b0f73d26477 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:37.021946 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155eea-f0a4-447c-b1ac-d7e6cf6ad92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:37.022783 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155eea-f0a4-447c-b1ac-d7e6cf6ad92b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:37.023129 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155eea-f0a4-447c-b1ac-d7e6cf6ad92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:37.023494 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155eea-f0a4-447c-b1ac-d7e6cf6ad92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:37.024478 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155eea-f0a4-447c-b1ac-d7e6cf6ad92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:37.026959 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155eea-f0a4-447c-b1ac-d7e6cf6ad92b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:37.042119 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1440/2863] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:37.047903 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:37.058531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933fe21-924d-4198-9ebb-3a20911730ac admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:37.063634 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:37.064344 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:37.064625 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:37.064896 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] PATH_INFO: `/v3/projects/661d545ee3dd4b379f1a5f3ecc44eaec/users/46f3e7945e21409aab22e845fe16b768/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:37.066985 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=661d545ee3dd4b379f1a5f3ecc44eaec, user_id=46f3e7945e21409aab22e845fe16b768, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:37.069660 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:37.082738 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1424/2864] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:37 2022] PUT /identity/v3/projects/661d545ee3dd4b379f1a5f3ecc44eaec/users/46f3e7945e21409aab22e845fe16b768/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:37.150984 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8696fb8-7261-4414-a62b-ecfbf147ebef None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:37.151225 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8696fb8-7261-4414-a62b-ecfbf147ebef None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:37.151517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8696fb8-7261-4414-a62b-ecfbf147ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:37.185660 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e8696fb8-7261-4414-a62b-ecfbf147ebef None None] MFA Rules not processed for user `46f3e7945e21409aab22e845fe16b768`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:37.186929 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e8696fb8-7261-4414-a62b-ecfbf147ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:37.258737 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1441/2865] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:37.270162 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:37.272244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:37.330325 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bcf26-791e-4c56-ba35-05ca2a664ebf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:37.334881 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57996979-dd8b-45ed-bb4c-29fa7aeba47f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:37.335495 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996979-dd8b-45ed-bb4c-29fa7aeba47f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:37.335662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996979-dd8b-45ed-bb4c-29fa7aeba47f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:37.335939 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996979-dd8b-45ed-bb4c-29fa7aeba47f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:37.371609 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:37.407328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57996979-dd8b-45ed-bb4c-29fa7aeba47f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:37.408774 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57996979-dd8b-45ed-bb4c-29fa7aeba47f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:37.418268 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1425/2866] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:39.984235 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8696fb8-7261-4414-a62b-ecfbf147ebef None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:40.003711 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:40.048986 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8696fb8-7261-4414-a62b-ecfbf147ebef None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:40.054438 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:40.055058 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:40.055339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:40.055595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] PATH_INFO: `/v3/users/07be25a8f04846ce99a281c04c67171d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:40.056842 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07be25a8f04846ce99a281c04c67171d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:40.058794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:40.110214 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07be25a8f04846ce99a281c04c67171d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.122491 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07be25a8f04846ce99a281c04c67171d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.129441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07be25a8f04846ce99a281c04c67171d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.130155 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07be25a8f04846ce99a281c04c67171d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.130799 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07be25a8f04846ce99a281c04c67171d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.150130 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1442/2867] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:39 2022] DELETE /identity/v3/users/07be25a8f04846ce99a281c04c67171d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:40.154947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:40.155438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:40.155556 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:40.175136 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:40.176418 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:40.236973 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1426/2868] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:40.246964 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:40.248607 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:40.309171 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebb1c9-c26b-4ff4-ae34-0c79af02c708 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:40.313654 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:40.314247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:40.314517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:40.314788 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:40.324256 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:40.325695 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:40.335200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1443/2869] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:40.614581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:40.616101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:40.628799 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054039f-7f44-443e-9c00-b2a599408bc2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:40.633751 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:40.634384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:40.634656 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:40.634920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] PATH_INFO: `/v3/projects/375b766bab394eaa977c230fe4c2f98a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:40.636071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] RBAC: Authorizing `identity:delete_project(project_id=375b766bab394eaa977c230fe4c2f98a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:40.638108 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:40.687216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375b766bab394eaa977c230fe4c2f98a', 'request_id': 'req-3e7bc313-557b-4d9b-8921-2d36186a606b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.692865 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375b766bab394eaa977c230fe4c2f98a', 'request_id': 'req-3e7bc313-557b-4d9b-8921-2d36186a606b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.701302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375b766bab394eaa977c230fe4c2f98a', 'request_id': 'req-3e7bc313-557b-4d9b-8921-2d36186a606b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.712643 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] The token cache is being invalidate because project 375b766bab394eaa977c230fe4c2f98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:40.712928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.713596 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.715090 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1427/2870] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:40 2022] DELETE /identity/v3/projects/375b766bab394eaa977c230fe4c2f98a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:40.719244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:40.729153 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb39a0-8d50-4ccf-892f-4bd887faa821 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:40.771709 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:40.776205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:40.778072 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:40.794254 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:40.794890 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:40.795170 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:40.795432 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] PATH_INFO: `/v3/users/46f3e7945e21409aab22e845fe16b768` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:40.796688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f3e7945e21409aab22e845fe16b768)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:40.798707 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:40.843641 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:40.847566 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f3e7945e21409aab22e845fe16b768'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.847860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bc313-557b-4d9b-8921-2d36186a606b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:40.854242 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:40.854892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:40.855336 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:40.855892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] PATH_INFO: `/v3/users/500be0a88c4f435bbc40a6c442825438` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:40.857310 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500be0a88c4f435bbc40a6c442825438)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:40.859686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:40.861147 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f3e7945e21409aab22e845fe16b768'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.868102 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f3e7945e21409aab22e845fe16b768'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.868782 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f3e7945e21409aab22e845fe16b768'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.869718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-85af4e2b-5646-44f9-8bfa-ccdd8dd7921b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f3e7945e21409aab22e845fe16b768'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.884209 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1444/2871] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:40 2022] DELETE /identity/v3/users/46f3e7945e21409aab22e845fe16b768 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:40.910866 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500be0a88c4f435bbc40a6c442825438'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.911740 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500be0a88c4f435bbc40a6c442825438'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.921223 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500be0a88c4f435bbc40a6c442825438'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.930244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500be0a88c4f435bbc40a6c442825438'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.930854 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500be0a88c4f435bbc40a6c442825438'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:40.948469 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1428/2872] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:40 2022] DELETE /identity/v3/users/500be0a88c4f435bbc40a6c442825438 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:40.953217 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:40.953510 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:40.953821 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:40.974325 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:40.975543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.038833 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1445/2873] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:44:41.048653 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.050155 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.108638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42497fc2-d527-41cc-8a1d-18c2a1582230 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.112608 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6673f-3ab4-4d29-8aa8-d7f84f5e9ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.113259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6673f-3ab4-4d29-8aa8-d7f84f5e9ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.113638 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6673f-3ab4-4d29-8aa8-d7f84f5e9ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.113908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6673f-3ab4-4d29-8aa8-d7f84f5e9ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.122852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6673f-3ab4-4d29-8aa8-d7f84f5e9ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.124696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6673f-3ab4-4d29-8aa8-d7f84f5e9ed9 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.134144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1429/2874] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:41.166069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.167617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.182259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e516cef-ba53-48b4-b07c-6affbe20b4ac None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.187870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.188539 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.188816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.189091 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] PATH_INFO: `/v3/projects/661d545ee3dd4b379f1a5f3ecc44eaec` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.190316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=661d545ee3dd4b379f1a5f3ecc44eaec)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.192316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.244273 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661d545ee3dd4b379f1a5f3ecc44eaec', 'request_id': 'req-d775bd52-715a-4573-8dd7-aab30063da7d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.250538 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661d545ee3dd4b379f1a5f3ecc44eaec', 'request_id': 'req-d775bd52-715a-4573-8dd7-aab30063da7d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.251923 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:41.258341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661d545ee3dd4b379f1a5f3ecc44eaec', 'request_id': 'req-d775bd52-715a-4573-8dd7-aab30063da7d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.273114 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] The token cache is being invalidate because project 661d545ee3dd4b379f1a5f3ecc44eaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:41.273406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.274141 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d775bd52-715a-4573-8dd7-aab30063da7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.276035 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1446/2875] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:41 2022] DELETE /identity/v3/projects/661d545ee3dd4b379f1a5f3ecc44eaec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:41.280729 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12c997-0bf7-40d1-9f29-5d7cf7eaa065 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.281257 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12c997-0bf7-40d1-9f29-5d7cf7eaa065 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.281950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12c997-0bf7-40d1-9f29-5d7cf7eaa065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.304631 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8c12c997-0bf7-40d1-9f29-5d7cf7eaa065 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:41.306134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c12c997-0bf7-40d1-9f29-5d7cf7eaa065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.367429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1430/2876] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:44:41.374994 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.375336 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.375655 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.400505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:41.401793 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.410743 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1447/2877] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:41.415404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12c997-0bf7-40d1-9f29-5d7cf7eaa065 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.425288 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12c997-0bf7-40d1-9f29-5d7cf7eaa065 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.430025 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.430628 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.430961 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.431182 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.432295 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:41.432606 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.434251 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.434383 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.435803 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.447227 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1431/2878] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:44:41.451583 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.452490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bdc3e-5ea6-43ec-8320-4aa4483ae598 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.457905 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.458617 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.458898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.459174 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] PATH_INFO: `/v3/projects/1f8b80fdd78e40a9af6882dba7c4090c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.460362 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8b80fdd78e40a9af6882dba7c4090c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.462367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.463098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6005405-ddca-452a-b291-a17828df6a4a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.468970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.469760 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.470279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.470552 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.471300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.473732 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.478852 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:41.506926 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1432/2879] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:41 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:41.510853 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.516567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8b80fdd78e40a9af6882dba7c4090c', 'request_id': 'req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.523132 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8b80fdd78e40a9af6882dba7c4090c', 'request_id': 'req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.532200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8b80fdd78e40a9af6882dba7c4090c', 'request_id': 'req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.547355 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] The token cache is being invalidate because project 1f8b80fdd78e40a9af6882dba7c4090c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:41.547544 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.548188 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:41.549824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1448/2880] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:41 2022] DELETE /identity/v3/projects/1f8b80fdd78e40a9af6882dba7c4090c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:41.578696 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759752b1-d648-4f6d-b456-99fb377a8c0b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.583879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.584534 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.584808 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.585071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.585793 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.587764 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.611543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1433/2881] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:41 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:41.615965 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.617518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.687708 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc5a86-8250-4f7e-b4c5-c0bb268e593b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.692688 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.693313 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.693614 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.693878 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.694522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.696126 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.707694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1449/2882] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:41.712014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.722721 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60240-1689-480d-916e-5e3182cc9d05 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.727837 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fb636-c2dc-475a-aca7-e13c5b3657ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.728474 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb636-c2dc-475a-aca7-e13c5b3657ba admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.728746 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb636-c2dc-475a-aca7-e13c5b3657ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.729012 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fb636-c2dc-475a-aca7-e13c5b3657ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.729715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fb636-c2dc-475a-aca7-e13c5b3657ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.731366 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fb636-c2dc-475a-aca7-e13c5b3657ba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.743382 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1434/2883] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:41.747996 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.759228 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449b25-38ca-44be-9f2b-38a481c4f39c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.764318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:41.764997 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.765278 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.765569 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] PATH_INFO: `/v3/projects/6dab5f182973447998108393f7255c1f/users/a3fa18ef774c4cbea569b3e0d415c6ab/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.783283 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dab5f182973447998108393f7255c1f, user_id=a3fa18ef774c4cbea569b3e0d415c6ab, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:41.785995 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:41.801837 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1450/2884] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:41 2022] PUT /identity/v3/projects/6dab5f182973447998108393f7255c1f/users/a3fa18ef774c4cbea569b3e0d415c6ab/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:41.816038 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086419-c6c2-4723-816c-7bc1048b9133 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:41.816328 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086419-c6c2-4723-816c-7bc1048b9133 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:41.816699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4086419-c6c2-4723-816c-7bc1048b9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:41.846332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f4086419-c6c2-4723-816c-7bc1048b9133 None None] MFA Rules not processed for user `a3fa18ef774c4cbea569b3e0d415c6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:41.847535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f4086419-c6c2-4723-816c-7bc1048b9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:41.914662 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1435/2885] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:41.919659 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:41.955826 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:41.994441 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b15ac-128e-4c15-b8c3-4b1e083f22d9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:41.999753 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.000338 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.000651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.000922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.001573 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.003504 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.032069 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1451/2886] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:41 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:42.036845 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086419-c6c2-4723-816c-7bc1048b9133 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.051758 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4086419-c6c2-4723-816c-7bc1048b9133 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.098873 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:42.108501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.109168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.109811 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.110079 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.110692 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.112626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.135851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1436/2887] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:42 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:42.140063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.151762 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd475fa-cac0-40fa-a445-f19851598597 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.157415 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.158049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.158328 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.158600 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.159244 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.160844 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.171990 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1452/2888] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:42.175994 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.187014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232b11b-298b-414f-ae25-3c954150aec7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.192334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d748f0e-fdfe-4d52-bd7b-785ba0dbe567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.192928 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d748f0e-fdfe-4d52-bd7b-785ba0dbe567 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.193212 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d748f0e-fdfe-4d52-bd7b-785ba0dbe567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.193481 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d748f0e-fdfe-4d52-bd7b-785ba0dbe567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.194173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d748f0e-fdfe-4d52-bd7b-785ba0dbe567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.195796 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d748f0e-fdfe-4d52-bd7b-785ba0dbe567 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.206480 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1437/2889] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:42.210341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.221752 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175829a-b77b-43d3-89fa-bf6bd3d3b407 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.229055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.230165 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.230621 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.231060 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] PATH_INFO: `/v3/projects/834ed1895fc6498ca0442705928b0b53/users/d106ebc695264271ae26ec0960e83cbd/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.246824 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=834ed1895fc6498ca0442705928b0b53, user_id=d106ebc695264271ae26ec0960e83cbd, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.249472 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.267998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1453/2890] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:42 2022] PUT /identity/v3/projects/834ed1895fc6498ca0442705928b0b53/users/d106ebc695264271ae26ec0960e83cbd/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:44:42.279851 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b763f54-efe7-4e9a-b38d-2af71859af0b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.280159 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b763f54-efe7-4e9a-b38d-2af71859af0b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.280457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b763f54-efe7-4e9a-b38d-2af71859af0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.314908 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6b763f54-efe7-4e9a-b38d-2af71859af0b None None] MFA Rules not processed for user `d106ebc695264271ae26ec0960e83cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:42.316308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6b763f54-efe7-4e9a-b38d-2af71859af0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:42.390607 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1438/2891] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:42.395343 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.459428 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2adfd-524a-4391-bab0-9b6615e2dccf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.465471 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.466092 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.466366 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.466626 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.467250 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.469346 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.503152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1454/2892] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:42 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:44:42.504404 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b763f54-efe7-4e9a-b38d-2af71859af0b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.519622 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b763f54-efe7-4e9a-b38d-2af71859af0b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.586007 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.586661 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.586938 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.587226 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.587840 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.589792 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.617179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1439/2893] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:42 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:42.621595 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.632497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bf1c6-6e2a-463a-8b4f-7826b59be567 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.640405 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.641408 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.641755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.642133 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.643057 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.645455 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.660253 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1455/2894] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:42.664987 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.680430 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f4a36-d0cc-4153-a572-3bf762533884 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.687762 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.688436 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.688720 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.689106 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] PATH_INFO: `/v3/projects/6c23f3a8967c47658353c2a55b646b29/users/20b434d4679b489aa57e3fd805496d44/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.705379 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c23f3a8967c47658353c2a55b646b29, user_id=20b434d4679b489aa57e3fd805496d44, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.708071 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.722333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1440/2895] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:42 2022] PUT /identity/v3/projects/6c23f3a8967c47658353c2a55b646b29/users/20b434d4679b489aa57e3fd805496d44/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:42.726433 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.736919 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863584f-05ac-4e8e-9204-dd07271a492d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.786983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:42.795341 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a32779-ea93-4946-b7a6-f2073fb2777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.795949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a32779-ea93-4946-b7a6-f2073fb2777c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.796231 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a32779-ea93-4946-b7a6-f2073fb2777c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.796505 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a32779-ea93-4946-b7a6-f2073fb2777c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.797175 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a32779-ea93-4946-b7a6-f2073fb2777c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.798827 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a32779-ea93-4946-b7a6-f2073fb2777c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.808870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1456/2896] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:42.813245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.824255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783ce73-9bcc-4b31-8983-677c2e2c38f6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:42.829561 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:42.830216 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.830497 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.830770 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] PATH_INFO: `/v3/projects/6c23f3a8967c47658353c2a55b646b29/users/20b434d4679b489aa57e3fd805496d44/roles/e97e5b9bfc8841a3ba7acb15d8e9c023` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.832790 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c23f3a8967c47658353c2a55b646b29, user_id=20b434d4679b489aa57e3fd805496d44, role_id=e97e5b9bfc8841a3ba7acb15d8e9c023)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:42.835471 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:42.845723 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1441/2897] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:42 2022] PUT /identity/v3/projects/6c23f3a8967c47658353c2a55b646b29/users/20b434d4679b489aa57e3fd805496d44/roles/e97e5b9bfc8841a3ba7acb15d8e9c023 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:42.856059 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:42.856367 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:42.856643 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:42.887376 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] MFA Rules not processed for user `20b434d4679b489aa57e3fd805496d44`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:42.888579 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:42.961226 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1457/2898] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:42.972477 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:42.974308 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:42.990504 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:43.035827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4ff1-6ed0-4fdd-8a68-7d14ea6bd379 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:43.040654 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:43.041531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:43.041954 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:43.042334 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:43.103575 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:43.105015 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:43.116616 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1442/2899] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:44.670489 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:44.672137 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:44.685372 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff3b35-e3ab-4ccd-9e9d-c9167294a65d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:44.689526 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:44.690149 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:44.690431 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:44.690705 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:44.750316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:44.751751 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:44.760903 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1458/2900] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:45.318187 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:45.327523 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638087de-b688-46c3-9365-5ca854035248 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:45.332173 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301ea66-df98-49ea-8489-9972fc49aaa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:45.332761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301ea66-df98-49ea-8489-9972fc49aaa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:45.333036 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301ea66-df98-49ea-8489-9972fc49aaa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:45.333313 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301ea66-df98-49ea-8489-9972fc49aaa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:45.342996 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301ea66-df98-49ea-8489-9972fc49aaa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:45.344757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301ea66-df98-49ea-8489-9972fc49aaa1 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:45.354801 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1443/2901] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:49.291054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:49.364805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e8a7-02fd-41dd-99ed-3ee880c98273 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:49.370381 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:49.370974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:49.371247 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:49.371517 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] PATH_INFO: `/v3/users/a3fa18ef774c4cbea569b3e0d415c6ab` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:49.372686 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fa18ef774c4cbea569b3e0d415c6ab)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:49.374656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:49.390771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:49.425501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fa18ef774c4cbea569b3e0d415c6ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:49.437955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fa18ef774c4cbea569b3e0d415c6ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:49.446067 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fa18ef774c4cbea569b3e0d415c6ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:49.446814 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fa18ef774c4cbea569b3e0d415c6ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:49.447503 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fa18ef774c4cbea569b3e0d415c6ab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:49.461193 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1459/2902] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:49 2022] DELETE /identity/v3/users/a3fa18ef774c4cbea569b3e0d415c6ab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:49.465970 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:49.466459 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:49.466558 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:49.486864 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:49.488082 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:49.557555 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1444/2903] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:49.569358 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:49.571054 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:49.636013 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b49c-72fd-4510-85d6-3c430a9c77b9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:49.640121 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:49.640784 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:49.641053 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:49.641316 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:49.650755 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:49.652152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:49.661759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1460/2904] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:49.947030 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:49.948676 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:49.960870 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0acff-e2fe-42c6-a324-d7bd4f694b28 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:49.965960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:49.966669 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:49.967013 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:49.967416 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] PATH_INFO: `/v3/projects/6dab5f182973447998108393f7255c1f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:49.969107 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dab5f182973447998108393f7255c1f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:49.971231 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:50.020899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dab5f182973447998108393f7255c1f', 'request_id': 'req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.022168 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:50.028146 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dab5f182973447998108393f7255c1f', 'request_id': 'req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.037191 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dab5f182973447998108393f7255c1f', 'request_id': 'req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.048626 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] The token cache is being invalidate because project 6dab5f182973447998108393f7255c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:50.048920 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.049711 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.051354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1445/2905] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:49 2022] DELETE /identity/v3/projects/6dab5f182973447998108393f7255c1f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:50.055501 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:50.065462 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c8f8a-0748-463c-b800-b9f7d085eee6 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:50.122493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:50.123128 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:50.123401 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:50.123669 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] PATH_INFO: `/v3/users/d106ebc695264271ae26ec0960e83cbd` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:50.124886 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d106ebc695264271ae26ec0960e83cbd)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:50.126848 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:50.167950 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:50.174804 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd106ebc695264271ae26ec0960e83cbd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.188651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd106ebc695264271ae26ec0960e83cbd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.195937 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd106ebc695264271ae26ec0960e83cbd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.196714 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd106ebc695264271ae26ec0960e83cbd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.197411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd106ebc695264271ae26ec0960e83cbd'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.212823 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1461/2906] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:50 2022] DELETE /identity/v3/users/d106ebc695264271ae26ec0960e83cbd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:50.484686 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:50.486371 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:50.501272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4d160-c34a-4a3f-b5a8-bdc0fefa5ae2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:50.567092 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:50.567933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:50.567933 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:50.568222 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] PATH_INFO: `/v3/projects/834ed1895fc6498ca0442705928b0b53` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:50.569388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=834ed1895fc6498ca0442705928b0b53)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:50.571368 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:50.621018 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834ed1895fc6498ca0442705928b0b53', 'request_id': 'req-afb4951f-ad56-4a63-b7cc-7d8e164e8119'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.627376 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834ed1895fc6498ca0442705928b0b53', 'request_id': 'req-afb4951f-ad56-4a63-b7cc-7d8e164e8119'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.635683 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834ed1895fc6498ca0442705928b0b53', 'request_id': 'req-afb4951f-ad56-4a63-b7cc-7d8e164e8119'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.647832 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] The token cache is being invalidate because project 834ed1895fc6498ca0442705928b0b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:50.648121 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.648838 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.650383 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1446/2907] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:50 2022] DELETE /identity/v3/projects/834ed1895fc6498ca0442705928b0b53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:50.654527 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:50.656076 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:50.668983 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121ec47-dabf-44ec-92a3-78bd650f2218 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:50.727794 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:50.728442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:50.728719 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:50.728985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] PATH_INFO: `/v3/users/20b434d4679b489aa57e3fd805496d44` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:50.730152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b434d4679b489aa57e3fd805496d44)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:50.732109 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:50.784306 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b434d4679b489aa57e3fd805496d44'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.796647 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b434d4679b489aa57e3fd805496d44'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.804279 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b434d4679b489aa57e3fd805496d44'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.805158 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b434d4679b489aa57e3fd805496d44'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.805888 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-731195b5-fa96-4901-9bfb-91de35bda91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b434d4679b489aa57e3fd805496d44'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:50.822182 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1462/2908] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:44:50 2022] DELETE /identity/v3/users/20b434d4679b489aa57e3fd805496d44 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:51.095384 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.097039 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:51.118531 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4951f-ad56-4a63-b7cc-7d8e164e8119 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:51.175533 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:51.176157 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.176441 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.176713 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] PATH_INFO: `/v3/projects/6c23f3a8967c47658353c2a55b646b29` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.177886 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c23f3a8967c47658353c2a55b646b29)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:51.179798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:51.191412 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:51.241200 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c23f3a8967c47658353c2a55b646b29', 'request_id': 'req-666be620-625a-45cf-a31b-f2cf3af4b80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:51.246947 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c23f3a8967c47658353c2a55b646b29', 'request_id': 'req-666be620-625a-45cf-a31b-f2cf3af4b80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:51.257571 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c23f3a8967c47658353c2a55b646b29', 'request_id': 'req-666be620-625a-45cf-a31b-f2cf3af4b80c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:51.271818 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] The token cache is being invalidate because project 6c23f3a8967c47658353c2a55b646b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:44:51.272093 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:51.272781 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-666be620-625a-45cf-a31b-f2cf3af4b80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:44:51.274353 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1447/2909] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:44:51 2022] DELETE /identity/v3/projects/6c23f3a8967c47658353c2a55b646b29 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:51.279679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66160344-3c53-4d7c-99e2-c6e0edf1c65c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.279962 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66160344-3c53-4d7c-99e2-c6e0edf1c65c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.280239 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66160344-3c53-4d7c-99e2-c6e0edf1c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.302073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-66160344-3c53-4d7c-99e2-c6e0edf1c65c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:51.303272 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-66160344-3c53-4d7c-99e2-c6e0edf1c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:51.341187 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:51.375561 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1463/2910] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:51.384658 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6548-8c3c-4ab1-b30d-b8acce1c4f06 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.384945 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6548-8c3c-4ab1-b30d-b8acce1c4f06 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.385245 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6548-8c3c-4ab1-b30d-b8acce1c4f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.412445 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7cab6548-8c3c-4ab1-b30d-b8acce1c4f06 None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:51.413757 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7cab6548-8c3c-4ab1-b30d-b8acce1c4f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:51.423298 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1448/2911] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:51.427816 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66160344-3c53-4d7c-99e2-c6e0edf1c65c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.437902 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66160344-3c53-4d7c-99e2-c6e0edf1c65c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:51.442825 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:51.443419 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.443694 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.443961 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.444612 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:44:51.444898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:51.446518 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:51.458497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1464/2912] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Aug 30 00:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:44:51.462874 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab6548-8c3c-4ab1-b30d-b8acce1c4f06 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.472548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab6548-8c3c-4ab1-b30d-b8acce1c4f06 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:51.477670 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:51.478261 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.478535 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.478804 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.479423 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:51.481317 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:51.510332 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1449/2913] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Aug 30 00:44:51 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:51.514587 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.524733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd3334-0a7a-45c3-85b1-256cc171029f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:51.598966 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:51.599492 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.599778 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.600055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.600679 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:51.602649 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:51.653339 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1465/2914] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Aug 30 00:44:51 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:44:51.655570 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.666898 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3b38-e59f-406f-ab3b-1a9705961229 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:51.672759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:51.673350 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.673655 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.673915 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.674549 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:51.676147 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:51.687330 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1450/2915] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:51.691388 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.743645 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31b81-b49d-4904-9bb8-56efa2513aa1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:51.749662 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c4bf4-0de0-4cfe-905c-3cc3356434e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:51.750291 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c4bf4-0de0-4cfe-905c-3cc3356434e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.750567 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c4bf4-0de0-4cfe-905c-3cc3356434e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.750830 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c4bf4-0de0-4cfe-905c-3cc3356434e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.751523 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c4bf4-0de0-4cfe-905c-3cc3356434e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:51.753163 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c4bf4-0de0-4cfe-905c-3cc3356434e2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:51.764152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1466/2916] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Aug 30 00:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:44:51.768614 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.812444 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418af4f-f2c7-47c0-be3a-7e6116b7c709 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:51.818144 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:51.818830 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.819087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.819289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] PATH_INFO: `/v3/projects/2584879443914e3d8ac4cd39cdc409df/users/d3184514111141c5a92235c31066643f/roles/440a5fbd07d0485ba8c5215d283387c5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.833992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2584879443914e3d8ac4cd39cdc409df, user_id=d3184514111141c5a92235c31066643f, role_id=440a5fbd07d0485ba8c5215d283387c5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:51.836611 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:51.850981 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1451/2917] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Aug 30 00:44:51 2022] PUT /identity/v3/projects/2584879443914e3d8ac4cd39cdc409df/users/d3184514111141c5a92235c31066643f/roles/440a5fbd07d0485ba8c5215d283387c5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:44:51.858263 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a19b30-bfb1-4190-9ec0-36cbc1a4343c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:51.858635 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a19b30-bfb1-4190-9ec0-36cbc1a4343c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:51.859049 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a19b30-bfb1-4190-9ec0-36cbc1a4343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:51.887410 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-60a19b30-bfb1-4190-9ec0-36cbc1a4343c None None] MFA Rules not processed for user `7f29f71fcc134e71ac6d471453d847e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:51.888610 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-60a19b30-bfb1-4190-9ec0-36cbc1a4343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:51.921970 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:51.954717 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1467/2918] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:51.965467 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:51.967326 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:52.038521 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:44:52.045666 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb2c4a-daae-42bc-bdea-cfc6d39bd75f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:52.050354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:52.050960 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:52.051239 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:52.051511 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:52.060574 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:52.062076 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:52.071924 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1452/2919] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:52.720592 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7f20-1a59-4fc2-88f4-8375501dcb98 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:52.721154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7f20-1a59-4fc2-88f4-8375501dcb98 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:52.721154 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7f20-1a59-4fc2-88f4-8375501dcb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:52.752065 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f0ff7f20-1a59-4fc2-88f4-8375501dcb98 None None] MFA Rules not processed for user `d3184514111141c5a92235c31066643f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:52.753300 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f0ff7f20-1a59-4fc2-88f4-8375501dcb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:52.825321 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1468/2920] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:44:52.836354 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:44:52.837841 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:52.900857 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d094d3-c83c-4719-9c53-b140cde3599c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:44:52.906289 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5301330fc789466ab0c1c4aae41b6330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:44:52.906929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:52.907205 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:52.907472 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:52.917646 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:44:52.919194 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:44:52.928699 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1453/2921] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:44:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:44:54.312981 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75af7e-badb-40b9-a792-b3edbd0dece1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:44:54.313522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75af7e-badb-40b9-a792-b3edbd0dece1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:44:54.313522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75af7e-badb-40b9-a792-b3edbd0dece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:44:54.333676 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1c75af7e-badb-40b9-a792-b3edbd0dece1 None None] MFA Rules not processed for user `d3184514111141c5a92235c31066643f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:44:54.334877 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1c75af7e-badb-40b9-a792-b3edbd0dece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:44:54.343285 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1469/2922] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:45:02.925061 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=31 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:45:03.219708 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:45:03.221329 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:45:03.316296 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adaaa3-ee43-4ff6-bad5-8cc5b20f3829 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:45:03.321844 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10026c3-9e89-4782-a34b-3852618e3db7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:45:03.322452 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10026c3-9e89-4782-a34b-3852618e3db7 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:03.322748 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10026c3-9e89-4782-a34b-3852618e3db7 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:03.322992 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10026c3-9e89-4782-a34b-3852618e3db7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:03.324675 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a10026c3-9e89-4782-a34b-3852618e3db7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:45:03.336897 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10026c3-9e89-4782-a34b-3852618e3db7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:45:03.338438 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10026c3-9e89-4782-a34b-3852618e3db7 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:45:03.349085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1454/2923] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:45:04.327896 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=46 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:45:07.221805 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:07.222411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:07.222411 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:07.243375 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] MFA Rules not processed for user `d3184514111141c5a92235c31066643f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:45:07.244574 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:45:07.251870 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1470/2924] 10.222.0.42 () {58 vars in 958 bytes} [Tue Aug 30 00:45:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:45:13.344506 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=41 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:45:17.237949 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:45:21.875455 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94efb7-51a9-42f3-8b1e-86db84cf8463 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:21.875929 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94efb7-51a9-42f3-8b1e-86db84cf8463 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:21.876043 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94efb7-51a9-42f3-8b1e-86db84cf8463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:21.906798 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9b94efb7-51a9-42f3-8b1e-86db84cf8463 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:45:21.908014 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9b94efb7-51a9-42f3-8b1e-86db84cf8463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:45:21.983095 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1455/2925] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Aug 30 00:45:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:45:22.037162 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:45:22.038680 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:45:22.107307 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fc92f-6ee7-4b1e-9cce-14a113708f51 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:45:22.113001 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:45:22.113633 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:22.113914 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:22.114184 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:22.123266 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:45:22.124368 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:45:22.133183 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1471/2926] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:45:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:45:31.975457 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=32 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:45:32.129627 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=32 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:45:36.599769 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690c99-c461-4901-8e81-bf45795e7303 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:36.600301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690c99-c461-4901-8e81-bf45795e7303 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:36.600301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690c99-c461-4901-8e81-bf45795e7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:36.631238 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6c690c99-c461-4901-8e81-bf45795e7303 None None] MFA Rules not processed for user `41b554a0c7e14ba381185ce80cac34af`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:45:36.633019 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6c690c99-c461-4901-8e81-bf45795e7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:45:36.645892 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1456/2927] 10.222.0.42 () {58 vars in 967 bytes} [Tue Aug 30 00:45:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:45:36.660691 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:45:36.671954 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2dfe8-645f-4ed7-b6ce-27ffc2b47877 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:45:36.678524 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba04cf2f81b4a33863e0789b706061e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:45:36.679123 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:36.679397 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:36.679651 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:36.688759 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:45:36.690373 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:45:36.698809 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1472/2928] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Aug 30 00:45:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:45:38.661255 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690c99-c461-4901-8e81-bf45795e7303 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:45:38.673201 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690c99-c461-4901-8e81-bf45795e7303 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:45:38.678862 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:45:38.679501 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:38.679779 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:38.680048 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] PATH_INFO: `/v3/users/d3184514111141c5a92235c31066643f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:38.681302 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3184514111141c5a92235c31066643f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:45:38.683300 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:45:38.738207 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3184514111141c5a92235c31066643f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:38.739097 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3184514111141c5a92235c31066643f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:38.750734 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3184514111141c5a92235c31066643f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:38.759879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3184514111141c5a92235c31066643f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:38.760520 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3184514111141c5a92235c31066643f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:38.778163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1457/2929] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:45:38 2022] DELETE /identity/v3/users/d3184514111141c5a92235c31066643f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:45:38.964319 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:45:38.980646 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9f4a-6bc4-413a-a328-3e196c76f035 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:45:39.041880 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:45:39.042508 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:45:39.042789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:45:39.043062 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] PATH_INFO: `/v3/projects/2584879443914e3d8ac4cd39cdc409df` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:45:39.044152 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2584879443914e3d8ac4cd39cdc409df)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:45:39.046140 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:45:39.095616 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2584879443914e3d8ac4cd39cdc409df', 'request_id': 'req-128b430b-955b-4f17-809f-51fd828600eb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:39.102218 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2584879443914e3d8ac4cd39cdc409df', 'request_id': 'req-128b430b-955b-4f17-809f-51fd828600eb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:39.109956 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2584879443914e3d8ac4cd39cdc409df', 'request_id': 'req-128b430b-955b-4f17-809f-51fd828600eb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:39.125448 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] The token cache is being invalidate because project 2584879443914e3d8ac4cd39cdc409df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:45:39.125780 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:39.126470 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:45:39.127985 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1473/2930] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:45:38 2022] DELETE /identity/v3/projects/2584879443914e3d8ac4cd39cdc409df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:45:48.774872 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:45:49.122167 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:46:40.161500 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:46:40.163047 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:46:40.250632 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00351f-a726-426f-b8b2-539bc4afd333 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:46:40.300267 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:46:40.300879 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:46:40.301158 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:46:40.301429 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:46:40.303279 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:46:40.312863 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:46:40.314322 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:46:40.322301 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1458/2931] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:46:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:46:40.400766 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:46:40.402318 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:46:40.415715 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b430b-955b-4f17-809f-51fd828600eb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:46:40.420063 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:46:40.420656 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:46:40.420927 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:46:40.421194 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:46:40.423418 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:46:40.519857 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:46:40.521200 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:46:40.542172 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1474/2932] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:46:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:46:50.318780 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=55 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:46:50.543073 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=43 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:47:58.183565 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:47:58.184986 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:47:58.202569 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60954fd8-91d3-4b01-a349-de205323502e service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:47:58.209937 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4e1f12814a4923a2a37d771c59d40c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:47:58.210545 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:47:58.210820 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:47:58.211087 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:47:58.212827 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:47:58.226085 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:47:58.227805 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:47:58.240179 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1459/2933] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:47:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:47:58.306776 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:47:58.308392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:47:58.319522 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48334e4-d9bd-49a6-8296-49a175eed3d4 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:47:58.323243 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:47:58.323845 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:47:58.324120 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:47:58.324387 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:47:58.326111 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:47:58.335728 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:47:58.337136 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:47:58.346148 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1475/2934] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:47:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:47:59.382925 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:47:59.392950 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a28d-feff-4951-a940-8f78c1cb9d63 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:47:59.396901 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:47:59.397484 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:47:59.397784 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:47:59.398046 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:47:59.399889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:47:59.414098 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:47:59.415498 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:47:59.426899 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1460/2935] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:47:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:48:00.619434 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:00.628490 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd91a-18a7-4c81-8ca7-1bfceaf1b578 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:00.633055 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77470d4430f04d30b64297de78e67f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:00.633671 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:00.633944 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:00.634204 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:00.636233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:00.650407 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:00.651733 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:00.663406 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1476/2936] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:48:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:48:09.421589 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=12 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:10.466700 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:10.468272 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:10.524342 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:10.526442 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:10.572581 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e21ec-4252-4752-8bab-a4cee1eebac8 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:10.577889 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:10.578532 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:10.578815 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:10.579056 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:10.580921 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:10.592548 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:10.594174 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:10.604333 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1461/2937] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:48:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:48:10.606008 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cadec-9a48-4d42-9a8f-f06f1e5402c4 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:10.616789 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:10.617435 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:10.617741 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:10.618004 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] PATH_INFO: `/v3/users/5121b4edd870476a8082e4f5787a52ee` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:10.619207 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5121b4edd870476a8082e4f5787a52ee)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:10.621145 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:10.668922 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5121b4edd870476a8082e4f5787a52ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:10.680493 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5121b4edd870476a8082e4f5787a52ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:10.687245 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5121b4edd870476a8082e4f5787a52ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:10.687906 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5121b4edd870476a8082e4f5787a52ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:10.688497 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5121b4edd870476a8082e4f5787a52ee'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:10.702912 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1477/2938] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:48:10 2022] DELETE /identity/v3/users/5121b4edd870476a8082e4f5787a52ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:10.879829 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:10.892836 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162c59-059c-445d-a730-635d5a2956ba service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:10.950860 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:10.951486 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:10.951759 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:10.952027 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] PATH_INFO: `/v3/projects/cdf9c319862348bcb932f57da4749cd1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:10.953244 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf9c319862348bcb932f57da4749cd1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:10.955324 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:11.003761 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf9c319862348bcb932f57da4749cd1', 'request_id': 'req-328d930a-5548-4eac-b4a2-672a351aee55'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.009453 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf9c319862348bcb932f57da4749cd1', 'request_id': 'req-328d930a-5548-4eac-b4a2-672a351aee55'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.018487 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf9c319862348bcb932f57da4749cd1', 'request_id': 'req-328d930a-5548-4eac-b4a2-672a351aee55'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.030259 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] The token cache is being invalidate because project cdf9c319862348bcb932f57da4749cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:48:11.030544 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.031208 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.032750 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1462/2939] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:48:10 2022] DELETE /identity/v3/projects/cdf9c319862348bcb932f57da4749cd1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:11.037024 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:11.038546 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:11.051787 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a65a45-ea64-483f-a020-615b92de672e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:11.100447 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:11.111392 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:11.112030 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:11.112519 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:11.113003 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] PATH_INFO: `/v3/users/e0256d8836ac4ea9a3a6c1e8b551b064` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:11.114169 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0256d8836ac4ea9a3a6c1e8b551b064)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:11.116080 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:11.165233 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0256d8836ac4ea9a3a6c1e8b551b064'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.177898 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0256d8836ac4ea9a3a6c1e8b551b064'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.185208 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0256d8836ac4ea9a3a6c1e8b551b064'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.185955 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0256d8836ac4ea9a3a6c1e8b551b064'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.186628 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0256d8836ac4ea9a3a6c1e8b551b064'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.201150 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1478/2940] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Aug 30 00:48:11 2022] DELETE /identity/v3/users/e0256d8836ac4ea9a3a6c1e8b551b064 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:11.374715 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:48:11.380388 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:48:11.398402 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d930a-5548-4eac-b4a2-672a351aee55 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:48:11.415979 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:11.463508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f29f71fcc134e71ac6d471453d847e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f231d500254452db95956e5ca509c67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:48:11.464134 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:48:11.464406 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:48:11.464671 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] PATH_INFO: `/v3/projects/22621a82bbda4e41a2829d7af4eb3165` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:48:11.465809 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22621a82bbda4e41a2829d7af4eb3165)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:48:11.467728 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:48:11.514508 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22621a82bbda4e41a2829d7af4eb3165', 'request_id': 'req-3084c0c8-a94f-4264-b967-1d03da0b8877'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.521101 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22621a82bbda4e41a2829d7af4eb3165', 'request_id': 'req-3084c0c8-a94f-4264-b967-1d03da0b8877'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.530475 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22621a82bbda4e41a2829d7af4eb3165', 'request_id': 'req-3084c0c8-a94f-4264-b967-1d03da0b8877'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.542163 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] The token cache is being invalidate because project 22621a82bbda4e41a2829d7af4eb3165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:48:11.542449 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.543088 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3084c0c8-a94f-4264-b967-1d03da0b8877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:48:11.544576 dv-cinder-815712-11-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1463/2941] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Aug 30 00:48:11 2022] DELETE /identity/v3/projects/22621a82bbda4e41a2829d7af4eb3165 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:48:21.197974 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:21.539543 dv-cinder-815712-11-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:06.021601 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:50:06.024463 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:06.106871 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b5d1d-13a9-49e3-93e2-1ff664ea0adb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:50:06.172122 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244140b-ab7d-4a2f-8db1-3a7b1b23bcb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab238ea3e0614e92a53cda1b0fc413f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20646077df5b45409498a71f7787f6e7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:50:06.172718 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244140b-ab7d-4a2f-8db1-3a7b1b23bcb3 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:50:06.172998 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244140b-ab7d-4a2f-8db1-3a7b1b23bcb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:50:06.173259 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244140b-ab7d-4a2f-8db1-3a7b1b23bcb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:50:06.175205 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6244140b-ab7d-4a2f-8db1-3a7b1b23bcb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:50:06.186771 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244140b-ab7d-4a2f-8db1-3a7b1b23bcb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:50:06.188345 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244140b-ab7d-4a2f-8db1-3a7b1b23bcb3 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:50:06.198543 dv-cinder-815712-11-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1479/2942] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Aug 30 00:50:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:50:16.194417 dv-cinder-815712-11-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=58 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}